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Abstract 

We study a family of problems, called Maximum Solution, where 
the objective is to maximise a linear goal function over the feasible in- 
teger assignments to a set of variables subject to a set of constraints. 
When the domain is Boolean (i.e. restricted to {0, 1}), the maximum so- 
lution problem is identical to the well-studied Max Ones problem, and 
the approximability is completely understood for all restrictions on the 
underlying constraints [Khanna et al., SIAM J. Comput., 30 (2001), pp. 
1863-1920]. We continue this line of research by considering domains con- 
taining more than two elements. We present two main results: a complete 
classification for the approximability of all maximal constraint languages 
over domains of cardinality at most 4, and a complete classification of 
the approximability of the problem when the set of allowed constraints 
contains all permutation constraints. Under the assumption that a con- 
jecture due to Szczepara holds, we give a complete classification for all 
maximal constraint languages. These classes of languages are well-studied 
in universal algebra and computer science; they have, for instance, been 
considered in connection with machine learning and constraint satisfac- 
tion. Our results are proved by using algebraic results from clone theory 
and the results indicates that this approach is very powerful for classifying 
the approximability of certain optimisation problems. 
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1 Introduction 

Our starting-point is the general combinatorial optimisation problem Max ONES(r) 
where T (known as the constraint language) is a finite set of finitary relations 
over {0, 1}. An instance of this problem consists of constraints from T ap- 
plied to a number of Boolean variables, and the goal is to find an assignment 
that satisfies all constraints while maximising the number of variables set to 
1. It is easy to see that by choosing the constraint language appropriately, 
Max ONES(r) captures a number of well-known problems, for instance, Max 
Independent Set (problem GT23 in [2]), and certain variants of Max 0/1 
Programming (problem MP2 in |2j). Many other problems are equivalent to 
Max Ones under different reductions: for instance, Max Set Packing (also 
known as Max Hypergraph Matching) and Max Ones are equivalent under 
PTAS-reductions [3]. 

The approximability (and thus the computational complexity) is known for 
all choices of T [37]. For any Boolean constraint language T, Max ONES(r) 
is either in PO or is APX-complete or poly-APX-complete or finding a so- 
lution of non-zero value is NP-hard or finding any solution is NP-hard. The 
exact borderlines between the different cases are given in [37] , Actually, two 
different problems are studied in [37J : the weighted problem (where each vari- 
able is assigned a non-negative weight and the objective is to find a solution 
of maximum total weight), and the unweighted problem (where each variable is 
assigned the weight 1). They prove that the approximability for the weighted 
and unweighted versions of the problem coincides. 

We will study a generalisation of Max Ones where variable domains are 
different from {0, 1}: this allows us to capture more problems than with Max 
Ones. For instance, this enables the study of certain problems in integer linear 
programming |28j , problems in multiple- valued logic |36j , and in equation solv- 
ing over Abclian groups [38 . For larger domains, it seems significantly harder 
to obtain an exact characterisation of approximability than in the Boolean case. 
Such a characterisation would, for instance, show whether the dichotomy conjec- 
ture for constraint satisfaction problems is true or not - a famous open question 
which is believed to be difficult 25 . Hence, we exhibit restricted (but still 
fairly general) families of constraint languages where the approximability can 
be determined. 

Let us now formally define the problem that we will study: Let BcN (the 
domain) be a finite set. The set of all n-tuples of elements from D is denoted 
by D n . Any subset of D n is called an n-ary relation on D. The set of all 
finitary relations over D is denoted by Rd ■ A constraint language over a finite 
set, D, is a finite set T C R D . Constraint languages are the way in which we 
specify restrictions on our problems. The constraint satisfaction problem over 
the constraint language T, denoted Csp(r), is defined to be the decision problem 
with instance (V, D, C), where 

• V is a set of variables, 

• D is a finite set of values (sometimes called a domain), and 
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• C is a set of constraints {C\, . . . , C q }, in which each constraint C 2 : is a pair 
(si,Ri) where Sj is a list of variables of length m.;, called the constraint 
scope, and Ri is an Wj-ary relation over the set D, belonging to T, called 
the constraint relation. 

The question is whether there exists a solution to (V, D, C) or not, that is, 
a function from V to D such that, for each constraint in C, the image of 
the constraint scope is a member of the constraint relation. To exemplify 
this definition, let NAE be the following ternary relation on {0,1}: NAE = 
{0, l} 3 \ {(0, 0, 0), (1, 1, 1)}. It is easy to see that the well-known NP-complete 
problem Not-All-Equal Sat can be expressed as Csp({iVAE}). 

The optimisation problem that we are going to study, Weighted Maximum 
SOLUTiON(r) (which we abbreviate W-Max SOL(r)) is defined as follows: 

Instance: Tuple (V, D,C, w), where D is a finite subset of N, (V,D,C) is a 
Csp(r) instance, and w : V — » N is a weight function. 

Solution: An assignment / : V — ► D to the variables such that all constraints 
are satisfied. 

Measure: w(v) ■ f(v) 
vev 

Example 1.1 Consider the domain D = {0, 1} and the binary relation R = 
{(0,0), (1,0), (0, 1)}. Then, W-Max SOL({i?}) is exactly the weighted Maxi- 
mum Independent Set problem. 

Although the W-Max SOL(r) problem is only defined for finite constraint 
languages, we will, in order to simplify the presentation, sometimes deal with 
sets of relations which are infinite. For a (possible infinite) set of relations X we 
will say that W-Max Sol(X) is tractable if W-Max Sol(F) is tractable for 
every finite subset Y of X. Here "tractable" may be containment in one of PO, 
APX, or poly-APX. Similarly, we say that W-Max Sol(X) is hard if there 
is a finite subset Y of X such that W-Max Sol(Y") is hard. Here "hard" will 
be one of APX-hard, poly-APX-hard or that it is NP-hard to find feasible 
solutions. 

Note that our choice of measure function in the definition of W-Max SOL(r) 
is just one of several reasonable choices. Another reasonable alternative, used 
in |38j . would be to let the domain D be any finite set and introduce an ad- 
ditional function g : D — > N mapping elements from the domain to natural 
numbers. The measure could then be defined as X^ev w ( v ) ' 9(f( v ))- This 
would result in a parameterised problem W-Max SOL(r,g) where the goal 
is to classify the complexity of W-Max SOL(r, g) for all combinations of con- 
straint languages T and functions g. Note that our definition of W-Max SOL(r) 
is equivalent to the definition of W-Max SOL(r,g) if in addition g is required 
to be injective. One of our motivations for the choice of measure function in 
the definition of W-Max SOL(r) is to stay closer to the definition of integer 
programming. 
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Only considering finite constraint language is in many cases not very re- 
strictive. Consider for instance integer programming over the bounded domain 
{0, . . . ,d— 1}. Each row in the constraint matrix can be viewed as an inequality 

a\X\ + a 2 x 2 + . . . + a k x k > b. 

Obviously, such an inequality is equivalent to the following three inequalities 

aixi + a 2 x 2 + . . . + ay k / 2 ^xy k/2 ^ - z > 
-aixx - a 2 x 2 - ... - ay k/2 ^xy k/2 ^ + z > 
z + a [k/2]+i + ■ ■ • + a k x k > b 

where z denotes a fresh variable that is given the weight in the objective 
function. By repeating this process, one ends up with a set of inequalities 
where each inequality contains at most three variables, and the optimal solution 
to this instance have the same measure as the original instance. There are at 
most 2 d + 2 d + 2 d different inequalities of length < 3 since the domain contains 
d elements, that is, we have reduced the problem to one with a finite constraint 
language. Finally, this reduction is polynomial-time: each inequality of length 
k in the original instance give rise to at most 3^ log 2 fe l = 0(k 2 ) inequalities and 
at most 0(k 2 ) new variables. 

While the approximability of W-Max Sol is well- understood for the Boolean 
domain, this is not the case for larger domains. For larger domains we are aware 
of three results, the first one is a tight (in) approximability results for W-Max 
SOL(r) when T is the set of relations that can be expressed as linear equations 
over Z p [38] (see also §6.3.1l where we define the problem formally). The second 
result is due to Hochbaum and Naor {28] and they study integer programming 
with monotone constraints, i.e., every constraint is of the form ax — by < c, 
where x and y are variables and a, b S N and c £ Z. In our setting, their re- 
sult is a polynomial time algorithm for certain constraint languages. The third 
result is a study of the approximability of certain logically defined constraint 
languages [36] . The main goal of this article is to gain a better understanding of 
non-Boolean W-Max Sol — for doing so, we will adapt the algebraic approach 
for Csps [131 [32] for studying the approximability of W- Max Sol. 

When the algebraic approach is applicable to a certain problem, there is 
an equivalence relation on the constraint languages such that two constraint 
languages which are equivalent under this relation have the same complexity. 
More specifically, two constraint languages are in the same equivalence class if 
they generate the same relational clone. The relational clone generated by T, 
captures the expressive power of T and is denoted by (r). Hence, instead of 
studying every possible finite set of relations it is enough to study the relational 
clones. Thus, given two constraint languages Ti and T 2 such that (Ti) = ^2) 
then, W-Max Sol(Fi) and W-Max SOL(r 2 ) are equivalent under polynomial- 
time reductions. 

The clone-theoretic approach for studying the complexity of Csps has been 
very successful: it has, for instance, made it possible to design new efficient 
algorithms and to clarify the borderline between tractability and intractabil- 
ity in many important cases. In particular the complexity of the Csp problem 
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over three element domains is now completely understood [TU]- In addition 
to the Csp problem it is possible to use the tools from universal algebra to 
prove complexity results in many other Csp-like problems. One example of 
such a problem is the quantified constraint satisfaction problem (QCsp), where 
variables can not only be existentially quantified but also universally quantified. 
The complexity of QCsp has successfully been attacked with the clone-theoretic 
approach [3[T7]. Furthermore, the #Csp problem [11] (where the number of so- 
lutions to a Csp is counted) have also benefitted from this approach. However, 
it seems that this technique cannot be used for some other CsP-like problems: 
notable exceptions are Max Csp [34] and the problem of enumerating all solu- 
tions to a Csp instance [JS] . For some problems it is the case that the relational 
clones are a useable tool in the boolean domain but not in larger domains. The 
enumeration problem is one such case |46j . 

We begin by proving that the algebraic approach is applicable to W-Max 
Sol and this result can be found in Theorem 13. jR In fact, we show that 
given two constraint languages Ti and T2 such that (Ti) = ^2), then W-Max 
SOL(ri) ^-reduces to W-Max Sol(F2), and vice-versa. An S-reduction is a 
certain strong approximation-preserving reduction: if (ri) = (r 2 ), then Y\ and 
Y2 are very similar with respect to approximability. For instance, if W-Max 
Sol(Fi) is NP-hard to approximate within some constant c, then W-Max 
SOL(r2) is NP-hard to approximate within c, too. The proof is accompanied 
by an example of how the approach can be used "in practice" for proving ap- 
proximability results. We note that the clone-theoretic approach was not used 
in the original classification of Max Ones and, consequently, the techniques we 
use differs substantially from those used in [37] . The results that we prove with 
the aid of Theorem l3.3l are the following: 

Result 1. Our first result concerns the complexity of W-Max Sol for maximal 
constraint languages. A constraint language T is maximal if, for any R ^ (r), 
r U {R} has the ability to express (in a sense to be formally defined later on) 
every relation in Rjj. Such languages have attracted much attention lately: 
for instance, the complexity of the corresponding Csp problems has been com- 
pletely classified. In [T3] the complexity was classified for domains \D\ < 3 
and necessary conditions for tractability was proved for the general case. More 
recently, in [8] , it was proved that those necessary conditions also are sufficient 
for tractability. Maximal constraint languages have also been studied in the 
context of machine learning [2J] and quantified Csps [TH], and they attract a 
great deal of attention in universal algebra, cf . the survey by Quackenbush [33J . 

Our results show that if T is maximal and \D\ < 4, then W-Max SOL(r) 
is either tractable, APX-complete, poly-APX-complcte, that finding any so- 
lution with non-zero measure is NP-hard, or that Csp(r) is not tractable. 
Moreover, we prove that under a conjecture by Szczepara [47] our classification 
of maximal constraint languages extends to arbitrary finite domains. In the 

"The proof is easy to adapt to other problems such as W-MlN Sol (the minimisation 
version of W-Max Sol) and AW-Max Sol (where both positive and negative weights are 
allowed) . 
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conference version [35] of this article we claimed that we had characterised the 
complexity of Max Sol for all maximal constraint languages. Unfortunately, 
there was a flaw in one of the proofs. We have managed to repair some of it by 
proving the weaker results as stated above, but the general case, when \D\ > 4 
and Szczepara's conjecture is not assumed to hold, remains open. We also note 
that the different cases can be efficiently recognised, i.e. the approximability of 
a maximal constraint language T can be decided in polynomial time (in the size 

of r). 

When proving this result, we identified a new large tractable class of W- 
Max SOL(r): generalised max-closed constraints. This class (which may be of 
independent interest) significantly extend some of the tractable classes of Max 
Ones that were identified by Khanna et al. [37]. It is also related to mono- 
tone constraints which have been studied in mathematical programming and 
computer science [27l [28J [51] . In fact, generalised max-closed constraints gen- 
eralise monotone constraints over finite domains. A certain kind of generalised 
max-closed constraints are relevant in constraint programming languages such 
as Chip [50] as is pointed out in [33]. It may thus be possible to extend such 
languages with optimisation capabilities by using the techniques presented in 
this article. 

Result 2. We completely characterise the approximability of W-Max SOL(r) 
when r contains all permutation constraints. Such languages are known as ho- 
mogeneous languages and Dalmau [S3J has determined the complexity of Csp(r) 
for all such languages while the complexity of the corresponding quantified Csps 
has been studied by Borner et al. [6]. Szendrei [48j provides a compact presen- 
tation of algebraic results on homogeneous algebras and languages. 

We show that W-Max SOL(r) is either tractable, APX-complete, poly- 
APX-complete, or that Csp(r) is not tractable. The four different cases can, 
just as in Result 1, be efficiently recognised. The proof is based on the char- 
acterisation of homogeneous algebras by Marczewski [40] and Marchenkov [39] . 
For each domain D, there exists a set of relations Qd such that every tractable 
homogeneous constraint language on D is a subset of Qd. The relations in Qd 
are invariant under a certain operation t : D 3 — > D (known as the discriminator 
on D) and the algebra (D; t) is an example of a quasi-primal algebra in the 
sense of Pixley [41] . We note that the tractable homogeneous constraint lan- 
guages have been considered earlier in connection with soft constraints [21j . i.e. 
constraints which allows different levels of 'desirability' to be associated with 
different value assignments [5J. In the terminology of [2T], these languages are 
invariant under a (Mjrtyj, Mjrty 2 , Mnrty 3 ) multimorphism. We also note that 
the tractable homogeneous languages extend the width-2 affine class of Max 
Ones that was identified by Khanna et al. [37]. 

We remark that we do not deal explicitly with the unweighted version of 
the problem (denoted Max SOL(r)), where all variables have weight 1. The 
reason for this is that the approximability classifications for Max SOL(r) can be 
deduced from the classifications for W-Max SOL(r) (for all constraint languages 
r considered in this paper). In fact, as we explain in Section [H Max SOL(r) 
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have the same approximability as W-Max SOL(r) when T one of the constraint 
languages considered in this article. 

The article is structured as follows: We begin by presenting some basics on 
approximability in f}2] The algebraic approach for studying W-Max Sol is 
presented in S]3] 3D identifies certain hard constraint languages, and Sj5] contains 
some tractability results. We continue with S|6]that contain Result 1 and $7] 
that contain Result 2. Finally, Sj8] contains some final remarks. 

2 Approximability, Reductions, and Complete- 
ness 

A combinatorial optimisation problem is defined over a set of instances (admis- 
sible input data); each instance I has a finite set sol(7) of feasible solutions 
associated with it. Given an instance I and a feasible solution s of I, m(I, s) 
denotes the positive integer measure of s. The objective is, given an instance I, 
to find a feasible solution of optimum value with respect to the measure m. The 
optimal value is the largest one for maximisation problems and the smallest one 
for minimisation problems. A combinatorial optimisation problem is said to be 
an NPO problem if its instances and solutions can be recognised in polynomial 
time, the solutions are polynomially bounded in the input size, and the objective 
function can be computed in polynomial time (see, e.g., [2])- 

We say that a solution s G sol(7) to an instance I of an NPO problem II is 
r- approximate if it is satisfying 



where OPt(7) is the optimal value for a solution to I. An approximation algo- 
rithm for an NPO problem II has performance ratio IZ(n) if, given any instance 
I of II with |/| = n, it outputs an 7?.(n)-approximate solution. 

We define PO to be the class of NPO problems that can be solved (to 
optimality) in polynomial time. An NPO problem II is in the class APX if 
there is a polynomial-time approximation algorithm for II whose performance 
ratio is bounded by a constant. Similarly, II is in the class poly- APX if there 
is a polynomial-time approximation algorithm for II whose performance ratio is 
bounded by a polynomial in the size of the input. Completeness in APX and 
poly-APX is defined using appropriate reductions, called AP-reductions and 
A-reductions respectively [22| [37] . AP-reductions are more sensitive than A- 
reductions and every AP-reduction is also an A-reduction [37] . In this paper we 
will not need the added flexibility of A-reductions for proving our poly-APX- 
completeness results. Hence, we only need the definition of AP-reductions. 

Definition 2.1 An NPO problem IT is said to be AP-reducible to an NPO 
problem II2 if two polynomial-time computable functions F and G and a constant 
a exist such that 
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(a) for any instance I of Hi, F(I) is an instance ofH 2 ; 

(b) for any instance I of Hi, and any feasible solution s' of F(I), G(I,s') is 
a feasible solution of I; 

(c) for any instance I of Hi, and any r > 1, if s' is an r- approximate solution 
of F(I) then G(I, s') is an (1 + (r — l)a + o(l))- approximate solution of 
I where the o-notation is with respect to \I\. 

An NPO problem H is APX-hard fpoly-APX-hardj if every problem in 
APX f poly- APX j is AP -reducible (A-reducible) to it. If, in addition, H is in 
APX ("poly- APX ), thenH is called APX-complete fpoly-APX-completej. 

It is a well-known fact (see, e.g., §8.2.1 in [5]) that AP-reductions compose. 
In some proofs we will use another kind of reduction, 5*-reductions. They are 
defined as follows: 

Definition 2.2 An NPO problem Hi is said to be S'-reduciblc to an NPO 
problem H2 if two polynomial-time computable functions F and G exist such 
that 

(a) given any instance I of Hi, algorithm F produces an instance I' — F(I) 
of H2, such that the measure of an optimal solution for I' , OPT(J'), is 
exactly OPT(J). 

(b) given V = F(F), and any solution s' to I' , algorithm G produces a solution 
s to I such that mi(I,G(s')) = 1712(1', s'), where mi is the measure for 
Hi and 1112 is the measure for H2 ■ 

Obviously, the existence of an ^-reduction from 11! to 1I2 imply the existence 
of an AP-reduction from IT to H 2 . The reason why we need S- reductions is 
that AP-reductions do not (generally) preserve membership in PO [37]. We 
also note that 5*-reduction preserve approximation thresholds exactly for prob- 
lems in APX: let IIi,Il2 be problems in APX, assume that it is NP-hard to 
approximate IIi within c, and that there exists an iS-reduction from Hi to II2. 
Then, it is NP-hard to approximate II2 within c, too. 

In some of our hardness proofs, it will be convenient for us to use a type of 
approximation-preserving reduction called L- reduction [5] . 

Definition 2.3 An NPO maximisation problem Hi is said to be L-reducible to 
an NPO maximisation problem II2 if two polynomial-time computable functions 
F and G and positive constants (3 and 7 exist such that 

(a) given any instance I of Hi, algorithm F produces an instance I 1 = F(I) 
of II2, such that the measure of an optimal solution for I', OPt(I'), is at 
most (3 ■ opt(7); 

(b) given I' — F(I), and any solution s' to V , algorithm G produces a solution 
s to I such that \mi(I, s) - OPt(/)| < 7 • \m 2 (I', s') - OPt(P)|, where mi 
is the measure for Hi and m 2 is the measure for H 2 . 

It is well-known (see, e.g., Lemma 8.2 in [2]) that, if IIi is L-reduciblc to II2 
and IIi £ APX then there is an AP- reduction from IIi to II2. 
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3 Algebraic Approach 

We sometimes need to define relations in terms of other relations, using cer- 
tain logical formulas. In these definitions we use the standard correspondence 
between constraints and relations: a relation consists of all tuples of values 
satisfying the corresponding constraint. Although, we sometimes use the same 
symbol for a constraint and its corresponding relation, the meaning will always 
be clear from the context. More specifically, for a relation R with arity a we 
will sometimes write R(xi, . . . , x a ) with the meaning (x\, . . . , x a ) £ R and the 
constraint ((x%, . . . , x a ), R) will sometimes be written as R{x%, . . . , x a ). 

An operation on a finite set D (the domain) is an arbitrary function / : D k — > 
D. Any operation on D can be extended in a standard way to an operation on 
tuples over D as follows: Let / be a fc-ary operation on D and let R be an n- 
ary relation over D. For any collection of k tuples, t%, . . . , tk £ R, the n-tuple 
f(t 1 ,t 2 , ■ ■ ■ ,tfc) is defined as follows: /(ii,t 2 , ...,**,) = (/(<i[l],*2[l], • ■ ■ , *fc [1]), 
/ (t x [2] , t 2 [2] , . . . , t k [2] ),..., /(ti [n] , t 2 [n] , . . . , t fe [n] ) ) , where [t] is the i-th com- 
ponent in tuple t j . A technique that has shown to be useful in determining the 
computational complexity of Csp(T) is that of investigating whether the con- 
straint language T is invariant under certain families of operations 32J. 

Now, let Ri G T. If / is an operation such that for all t\,t%,. .. ,tfe £ Ri 
/(iii^2, ■ ■ • ,tk) £ Ri, then Ri is invariant (or, in other words, closed) under /. 
If all constraint relations in T are invariant under /, then T is invariant under /. 
An operation / such that T is invariant under / is called a polymorphism of T. 
The set of all polymorphisms of T is denoted Pol(T). Given a set of operations 
F, the set of all relations that are invariant under all the operations in F is 
denoted Inv(F). Whenever there is only one operation under consideration, we 
write Inv(f) instead of Inv({f}). 

We will need a number of operations in the sequel: an operation / over D 
is said to be 

• a constant operation if / is unary and /(a) = c for all a £ D and some 
c £ D; 

• a majority operation if / is ternary and /(a, a, b) — /(a, 6, a) = f(b, a, a) = 
a for all a,b £ D; 

• a binary commutative idempotent operation if / is binary, /(a, a) = a for 
all b£D, and /(a, 6) = f(b, a) for all a,b £ D; 

• an affine operation if / is ternary and /(a, 6, c) = a — b+c for all a,b,c <E D 
where + and — are the binary operations of an Abelian group (D, +, — ). 

Example 3.1 Let D = {0, 1, 2} and let f be the majority operation on D where 
f(a,b,c) — a if a, b and c are all distinct. Furthermore, let 



R = {(0, 0, 1), (1, 0, 0), (2, 1, 1), (2, 0, 1), (1, 0, 1)}. 
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It is then easy to verify that for every triple of tuples, x,y, z £ R, we have 
f(x, y, z) G R. For example, if x — (0, 0, 1), y = (2, 1, 1) and z = (1, 0, 1) then 

f(x, y, z) = (f(x[l},y[l], z[l\), f(x[2],y[2],z[2]), f(x[3], y[3],*[3]) 

(/(0, 2, 1), /(0, 1, 0), /(l, 1, 1)) = (0, 0, 1) G R. 

We can conclude that R is invariant under f or, equivalently, that f is a poly- 
morphism of R. 

We continue by defining a closure operation (•} on sets of relations: for 
any set T C R D the set (r) consists of all relations that can be expressed 
using relations from T U {=d} (=d is the equality relation on D), conjunction, 
and existential quantification. Intuitively, constraints using relations from (F) 
are exactly those which can be simulated by constraints using relations from 
r. The sets of relations of the form (r) are referred to as relational clones. An 
alternative characterisation of relational clones is given in the following theorem. 

Theorem 3.2 (g3]) For every set T C R D , (V) = Inv(Pol(T)). 

The following theorem states that when we are studying the approximability 
of W-Max SOL(r), it is sufficient to consider constraint languages that are 
relational clones. 

Theorem 3.3 Let T be a constraint language and V C (r) finite. Then W- 
Max SoL(r') is S -reducible to W-Max SOL(r). 

Proof. Consider an instance I = (V, D, C, w) of W-Max Sol(T'). We transform 
I into an instance F(I) = (V, D, C, w') of W-Max SOL(r). 

For every constraint C — ((v±, . . . , v m ), R) in /, R can be represented as 

3t, m+1 , ■ • ■ , 3 v „Ri(vu, . . . , vi ni ) A • • • A Rk(vku ■ ■ ■ i v kn k ) 

where R\, . .. ,Rk G TU{—d}, v m +i, ■■■,v n are fresh variables, andvu, . . . ,v\ ni , 
«2i) ■ ■ ■ , ffcrifc 6 {wi, . . • , v n }. Replace the constraint C with the constraints 

((«n . . . ,vi ni ),Ri), . . . , ((wfci, ■ • .,v knk ),R k ), 

add v m+ i, . . . , v n to V, and extend w so that w m +i, ■ ■ .v n are given weight 0. 
If we repeat the same reduction for every constraint in C, then it results in an 
equivalent instance of W-Max Sol(Ti U {=£>})• 

For each equality constraint {{vi, Vj), =d), we do the following: 

• replace all occurrences of Vj with Vi, update w' so that the weight of Vj 
is added to the weight of V{, remove Vj from V, and remove the weight 
corresponding to Vj from w'; and 

• remove ((vi,Vj), =d) from C. 
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The resulting instance F(I) = (V , D, C, w') of W-Max Sol(T) has the same 
optimum as I (i.e., OPT(J) = OPT(F(7))) and has been obtained in polynomial 
time. 

Now, given a feasible solution S' for F(L), let G(I, £") be the feasible solution 
for / where: 

• The variables in I assigned by S' inherit their value from S' . 

• The variables in / which are still unassigned all occur in equality con- 
straints and their values can be found by simply propagating the values 
of the variables which have already been assigned. 

It should be clear that m(I, G(I, S')) — m(F(I), S') for any feasible solution 
5" for F(I). Hence, the functions F and G, as described above, is an S'-reduction 
from W-Max SOL(r') to W-Max Sol(T). 

To exemplify the use of the results in this section, we prove the following 
tight approximability result: 

Lemma 3.4 Let T be a finite constraint language over the domain {0,1}. // 
Max ONES(r) is in APX and not in PO, then there is a polynomial time 
approximation algorithm for MAX ONES(r) with performance ratio 2, and it is 
NP-hard to approximate MAX Ones(T) within 2 — e, for any e > 0. 

Proof (Sketch). It follows from the classification results in [37] that if Max 
ONES(r) is in APX and not in PO, then T is closed under the affine function 
f(x, y,z) — x — y + z (mod 2). It also follows from [37j Lemma 6.6] that Max 
ONES(r) is approximable within 2. 

In the Boolean domain, the structure of all relational clones is known. This 
classification was made by Emil Post in [42] and is often referred to as Post's 
lattice. A gentle introduction to boolean relations and Post's lattice can be 
found in pj)] [16] . 

By Theorem 13. 3[ it is enough to study the relational clones. By studying 
Post's lattice and the results for Max Ones in [37], one can conclude that there 
are three relational clones which are interesting in our case (i.e., there are three 
relational clones such that Max ONES(r) is in APX but not in PO). Those 
relational clones are called ILq, IL2 and IL3 and can be defined as follows [15] : 



IL 


= {xi + ■ 


■ ■ + x k 


= (mod 2) 


| k e N} 






= {xi + ■ 


■ ■ + x k 


= c (mod 2) | 


k e N, 


ce{0,i}} 


IL 3 


= {xi + ■ 


■ ■ + x k 


= c (mod 2) 


k even, 


c e{0,l}} 



We get the following inclusions from Post's lattice: ILq C IL2 and IL3 C LL2- 
It is proved in [38] that for a certain finite subset T of IL3, Max ONES(r) 
is NP-hard to approximate within 2 — e for all e > 0. As IL3 C IL2 we get 
that Max ONES(r) is NP-hard to approximate within 2 - e for all e > if 
<r> = IL 2 . 
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What remains to be done is to prove NP-hardness for approximating Max 
ONES(r) within 2 — e if (T) = IL Q . We do this with a reduction from Max- 
E3-Lin-2 which is the following problem: given a set of equations over Z 2 with 
exactly three variables per equation, satisfy as many equations as possible. It is 
proved in [29] that it is NP-hard to approximate Max-E3-Lin-2 within 2 — e 
for any e > 0. 

Let / be an instance of Max-E3-Lin-2. We will construct an instance /' of 
Max ONES(r) for a subset T of IL . Given an equation xi+x 2 +x 3 — 1 (mod 2) 
in / (we can assume that all equations have 1 on the right hand side [29]), we 
add the equation x\ + x 2 + X3 = z (where z is a fresh variable that only occurs 
in one equation) to Furthermore, we assign the weight zero to xi,x 2 and 2; 3 
and the weight one to z. It is not hard to see that a solution with measure m to 
/ can easily be transformed into a solution with measure m for It is also the 
case that a solution of measure m for /' can be seen as a solution with measure 
TYi for I. 



4 Hardness and Membership Results 

In this section, we first prove some general APX and poly-APX membership 
results for W-Max SOL(r). We also prove APX-complctcncss and poly-APX- 
completeness for some particular constraint languages. Most of our hardness 
results in subsequent sections are based on these results. 

We begin by making the following easy but interesting observation: we know 
from the classification of W-Max SOL(r) over the Boolean domain {0, 1} that 
there exist many constraint languages T for which W-Max SOL(r) is poly- 
APX-complete. However, if is not in the domain, then there are no constraint 
languages T such that W-Max SOL(r) is poly-APX-completc. 

Proposition 4.1 // Csp(F) is in P and £ D, then W-Max SOL(r) is in 
APX. 

Proof. It is proved in [19] that if Csp(r) is in P, then we can also find a solution 
in polynomial time. It should be clear that this solution is a ™^[^ j -approximate 
solution. Hence, we have a trivial approximation algorithm with performance 



Next, we present a general membership result for W-Max SOL(r). The 
proof is similar to the proof of the corresponding result for the Boolean domain 
in [371 Lemma 6.2] so we omit the proof. 

Lemma 4.2 Let T c = {T U {{(di)}, . . . , {(d n )}}, where D = {di, . . . , d n } (i.e., 
r c is the constraint language corresponding to T where we can force variables to 
take any given value in the domain). If Csp(r c ) is in P, then W-Max SOL(r) 
is in poly-APX. 

We continue by proving the APX-completeness of some constraint lan- 
guages. 
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Lemma 4.3 Let R = {(a,a),(a,b),(b,a)} and a,b G D such that < a < b. 
Then, W-Max Sol({77}) is APX-complete. 

Proof. Containment in APX follows from Proposition l4.il To prove the hard- 
ness result we give an L- reduction (with parameters /3 = 4b and 7 = r^— ) from 
the APX-complete problem Independent Set restricted to degree 3 graphs [lj 
to Max Sol({77}). Given an instance 7 = (V, E) of Independent Set (re- 
stricted to graphs of degree at most 3 and containing no isolated vertices), 
let F(I) = (V, D, C) be the instance of Max Sol({77}) where, for each edge 
(vi,Vj) € E, we add the constraint R(xi,Xj) to C. For any feasible solution S' 
for F(I), let G(I,S') be the solution for 7 where all vertices corresponding to 
variables assigned b in 5" form the independent set. We have \V\/4 < opt(J) 
and opt(F (I)) < b\V\ so opt(F(/)) < 46opt(7). Thus, (3 = 4& is an appropri- 
ate parameter. 

Let K be the number of variables being set to b in an arbitrary solution S' 
for F(I). Then, 

|opt(7) - m(I, G(I, S'))\ = opt(J) - K and 
|opt(F(Z)) - m(F{I), S')\ = {b- o)(opt(7) - K). 

Hence, 

|0PT(7)-m(7,G(7.S")| = 1 -^|opt(7 1 (7)) - m(F(I), S')\ 

b — a 

and 7 = is an appropriate parameter. 

The generic poly- APX-complete constraint languages are presented in the 
following lemma. 

Lemma 4.4 Let R = {(0,0), (0,6), (6,0)} and b 6 D such that < b. Then, 
W-Max SOL({i?}) is poly-APX-complete. 

Proof. It is proved in [371 Lemma 6.15] that for Q = {(0,0), (0, 1), (1,0)}, it is 
the case that W-Max Sol({Q}) is poly-APX-complete. To prove the poly- 
APX-hardness we give an AP-reduction from W-Max Sol({<2}) to W-Max 
Sol({7i!}). Given an instance 7 of W-Max Sol({Q}), let F(7) be the instance 
of W-Max Sol({7J}) where all occurrences of Q has been replaced by 7?. For 
any feasible solution S' for F(I), let G(I,S') be the solution for 7 where all 
variables assigned b in S' are instead assigned 1. It should be clear that this is 
an AP-reduction, since if 5" is an a-approximate solution to F(I), then G(7, S') 
is an a-approximate solution for 7. 

To see that W-Max Sol({77,}) is in poly-APX, let D = {d 1} ...,d n } and 
note that T c = {77,, {(<ii)}, . . . , {(d n )}} is invariant under the min function. 
As the min function is associative, commutative and idempotent, Csp(r c ) is 
solvable in polynomial time [32]. Hence, W-Max Sol({77}) is in poly-APX 
due to Lemma [4~2l 
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5 Tractable Constraint Languages 

In this section, we present tractability results for two classes of constraint lan- 
guages: injective constraint languages and generalised max-closed constraint lan- 
guages. The tractability of injective constraints follows from Cohen et al. [2TJ 
Sec. 4.4] but we present a simple proof for increased readability. The tractabil- 
ity result for generalised max-closed constraints is new and its proof constitutes 
the main part of this section. 

These two classes can be seen as substantial and nontrivial generalisations 
of the tractable classes known for the corresponding (Weighted) Max Ones 
problem over the Boolean domain. There are only three tractable classes of 
constraint languages over the Boolean domain, namely width-2 afhne, 1-valid, 
and weakly positive [3?]. Width-2 affine constraint languages are examples of 
injective constraint languages and the classes of 1-valid and weakly positive con- 
straint languages are examples of generalised max-closed constraint languages. 
The monotone constraints which are, for instance, studied by Hochbaum et 
al. |271 28J (in relation with integer programming) and Woeginger |51j (in re- 
lation with constraint satisfaction) are also related to generalised max-closed 
constraints. Hochbaum & Naor [28] show that monotone constraints can be 
characterised as those constraints that are simultaneously invariant under the 
max and min operators. Hence, monotone constraints are also generalised max- 
closed constraints as long as the underlying domain is finite. 

5.1 Injective relations 

We begin by formally defining injective relations. 

Definition 5.1 A relation, R € Rrj, is called injective if there exists a subset 
D' C D and an injective function 7r : D' — > D such that 

R = {{x,n(x)) | x e D'}. 

It is important to note that the function tt is not assumed to be total on D. Let 
I D denote the set of all injective relations on the domain D and let Tf = (I D ). 

Example 5.2 Let D = {0,1} and let R — {{x,y) \ x, y S D, x + y = 
1 (mod 2)}. The relation R is injective because the function f : D — > D defined 
as /(0) = 1 and f(l) — is injective. More generally, let G = (D' , +, — ) be an 
arbitrary Abelian group and let c £ D' be an arbitrary group element. It is easy 
to see that the relation {(x,y) x,y G D' , x + y = c} is injective. 

R is an example of a relation which is invariant under an affine operation. 
Such relations have previously been studied in relation with the Max Ones 
problem in [37l [38] . We will give some additional results for such constraints in 
t j6.3l With the terminology used in [3"T1 [55] , R is said to be width-2 affine. The 
relations which can be expressed as the set of solutions to an equation with two 
variables over an Abelian group are exactly the width-2 affine relations, so the 
injective relations are a superset of the width-2 affine relations. 
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To see that W-Max Sol(T) is in PO for every finite constraint language 
T C (I D ), it is sufficient to prove that W-Max Sol(I d ) is in PO by Theo- 
rcm 13.31 Given an instance of W-Max Sol(I d ), consider the graph having the 
variables as vertices and edges between the vertices/ variables occurring together 
in the same constraint. Each connected component of this graph represents an 
independent subproblem that can be solved separately. If a value is assigned to 
a variable/vertex, all variables/ vertices in the same component will be forced 
to take a value by propagating this assignment. Hence, each connected compo- 
nent has at most \D\ different solutions (that can be easily enumerated) and an 
optimal one can be found in polynomial time. 

5.2 Generalised Max-Closed Relations 

We begin by giving the basic definition: 

Definition 5.3 A constraint language T over a domain D C N is generalised 
max-closed if and only if there exists a binary operation f G Pol(T) such that 
for all a, b € D, 

1. if a =/= b and /(a, b) < min(a, b), then /(&, a) > max(a, b); and 

2. /(a, a) > a. 

In the conference version of this article [35], the definition of generalised 
max-closed constraint languages was slightly more restrictive. The following 
two examples will clarify the definition above. 

Example 5.4 Assume that the domain D is {0,1,2,3}. As an example of a 
generalised max-closed relation consider 

R= {(0,0), (1,0), (0,2), (1,2)}. 

R is invariant under max and is therefore generalised max-closed since max 
satisfies the properties of Definition \5.3\ Now, consider the relation Q defined 
as 

Q = {(0,1), (1,0), (2,1), (2,2), (2,3)}. 
Q is not invariant under max because 

max((0, 1), (1, 0)) = (max(0, 1), max(l, 0)) = (1, 1) </ Q. 

Let the operation o : D 2 —> D be defined by the following Cayley tabled 



o 





1 


2 


3 








2 


2 


3 


1 


2 


1 


2 


2 


2 


2 


2 


2 


3 


3 


3 


2 


3 


3 



^Note that we write x o y instead of o(x, y). 
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Now, it is easy to verify that Inv(o) is a set of generalised max-closed relations 
and that Q G Inv(o). 

Example 5.5 Consider the relations R± and R2 defined as, 

Rt = {(1,1,1), (1,0,0), (0,0,1), (1,0,1)} 

and i?2 = Ri \ {(1,1,1)}- The relation R\ is 1-valid because the all-1 tuple 
is in Ri, i.e., (1,1,1) G R\. R2, on the other hand, is not 1-valid but is 
weakly positiv^ because it is invariant under max. Note that both R\ and R2 
are generalised max-closed since Ri is invariant under f(x, y) = 1 and R2 is 
invariant under f(x,y) = max(ir, y). It is in fact the case that every weakly 
positive relation is invariant under max (more is true in the Boolean domain: 
a relation is weakly positive if and only if it is invariant under max), so the 
1-valid and weakly positive relations are subsets of the generalised max-closed 
relations. 

The tractability of generalised max-closed constraint languages crucially de- 
pends on the following lemma. 

Lemma 5.6 IfT is generalised max-closed, then all relations 

R = {(dn, di2, . . . , dim), ■ ■ ■ , {dtl, d t 2, ■ ■ ■ , dtm)} 

in r have the property that the tuple 

''max (max{du, . . . , dti}, ■ ■ ■ ,max{di m , . . . ,d tm }) 

is in R, too. 

Proof. Assume that there is a relation R in F such that the tuple 

''max 

(maxjdn, . . . , dti}, ■ ■ ■ , max{di m , . . .,d tm }) 

is not in R. Define the distance between two tuples to be the number of co- 
ordinates where they disagree (i.e. the Hamming distance). Let a be a tuple 
in R with minimal distance from f max and let I denote the set of coordinates 
where a agrees with i max - By the assumption that t max is not in R, we know 
that the distance between a and t max is at least 1. Hence, without loss of 
generality, assume that a[l] ^ t m ax[l] and that a[l] is maximal for all tuples in 
R agreeing with £ ma x on the coordinates in I. Let b be a tuple in R such that 

6[1] =*max[l]. 

Since T is generalised max-closed, there exists an operation / € Pol(T) 
such that for all a, b G D (a ^ b), it holds that f(a,b) > max(a,6) whenever 
f(b,a) < min(a, b). Furthermore, for all a G D it holds that f(a,a) > a. Now 
consider the tuple x n (n = \D\) defined as follows: x 1 = f(a,b) and 



+A relation is weakly positive if it can be expressed as a CNF formula having at most one 
negated variable in each clause. 
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x 



.i+l 



{ 



f(x\a) 



iif(x i [l],a[l})>a[l], 



otherwise. 



We begin by proving that x n agrees with a on all coordinates in /. Let z be 
an arbitrary tuple in R. Note that for each i £ I such that z[i] ^ a[i], it is the 
case that /(a[i],z[i]) < min(a[i], z[i]) implies that /(z[i],a[£]) > max(a[i], z[i]). 
Hence, as a[i] = t max [i], we cannot have that /(a[z],z[z]) < min(a[z], z[i]). So, 
for each z £ R and i £ I, we must have /(a[z],z[i]) > min(a[i], z[i]) whenever 
a[i] ^ z[i]. By an analogous argument, it follows that for each z £ R and i £ I 
we must have f(z[i], a[i]) > mm(a[i], z[i]) whenever a[i) ^ z[i). 

This together with the fact that f(d, d) > d, for all d £ D, and that a agrees 
with t max on / implies that /(a, x n ) agrees with a on /. 

We now show that x n [l] > a[l]. This follows from essentially the same ar- 
gument as above. First note that /(a[l],6[l]) = x 1 ^] > a[l]. If /(a[l],6[l]) < 
min(a[l], b[l]), then /(b[l],a[l]) > b[l] which is not possible since b[l] — 
*max[l]- Hence, we must have /(a[l],6[l]) = a; 1 [l] > min(a[l], b[l]). Now, by 
the definition of x' l+1 , it follows that if x i [1] > o[l], then a3 i+1 [l] > min(a; i [l], a[l]) = 
a[l] (just note that at least one of /(a;*[l], o[l]) and /(a[l], £c l [l]) is strictly 
larger than min(a; , '[l], a[l]) = o,[l]). Hence, it follows by induction that x n [l] > 



Thus, we have a contradiction with the fact that a[l] is maximal for all tuples 
in R agreeing with i max on the coordinates in i\ Hence, our assumption was 
wrong and i max is in R. 

The algorithm for solving W-Max Sol(T) when T is generalised max-closed 
is a simple consistency-based algorithm. The algorithm, which is based on 
pair-wise consistency, closely follows the algorithm for Csps over max-closed 
constraint languages from [33j . 

We first need to introduce some terminology. 

Definition 5.7 Given a constraint C'i — (si,Ri) and a (ordered) subset of 
the variables in Si where (ii, . . . , ik) are the indices in s, of the elements in s[. 
The projection of Ci onto the variables in s[ is denoted by 7r s <Cj and defined as: 
7r s '.Cj = C[ = (s^, R'j) where R[ is the relation {(a[ii\, afa], ■ ■ ■ , a[ik]) | a £ FU,}- 

Definition 5.8 For any pair of constraints Ci = (si,Ri), Cj = (sj,Rj), the 
join of Ci and Cj, denoted Ci N Cj, is the constraint on S{ U Sj containing all 
tuples t such that Tr Si {t} £ Ri and ir Sj {t} £ Rj . 

Definition 5.9 ([30]) An instance of a constraint satisfaction problem I = 
(V, D, C) is pair-wise consistent if and only if for any pair of constraints Ci — 
(sj, Ri), Cj — (sj, Rj) in C , it holds that the constraint resulting from projecting 
Ci onto the variables in Si n Sj equals the constraint resulting from projecting 
Cj onto the variables in D Sj, i.e., Tr Sir , Sj Ci = n SinSj Cj. 



a[l]. 



We are now ready to prove the tractability of generalised max-closed con- 
straint languages. 
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Theorem 5.10 If T is generalised max-closed, then W-Max Sol(T) is in 
PO. 

Proof. Since Inv(f) is a relational clone, constraints built over Inv(f) are 
invariant under taking joins and projections [311 Lemma 2.8] (i.e., the under- 
lying relations are still invariant under /). It is proved in [30] that any set 
of constraints can be reduced to an equivalent set of pair-wise consistent con- 
strains in polynomial time. Since the set of pair-wise consistent constraints can 
be obtained by repeated application of the join and projection operations, the 
underlying relations in the resulting constraints are still in Inv(f). 

Hence, given an instance I = (V,D,C,w) of W-Max Soh(Inv(f)), we can 
assume that the constraints in C are pair-wise consistent. We prove that for 
pair-wise consistent C, cither C has a constraint with a constraint relation that 
do not contain any tuples (i.e., no assignment satisfies the constraint and there 
is no solution) or we can find the optimal solution in polynomial time. 

Assume that C has no empty constraints. For each variable Xi, let di be 
the maximum value allowed for that variable by some constraint Cj (where Xi 
is in the constraint scope of Cj). We will prove that {d\, . . . , d n ) is an optimal 
solution to /. Obviously, if (di, . . . , d n ) is a solution to J, then it is the optimal 
solution. Hence, it is sufficient to prove that (d\, . . . , d n ) is a solution to I. 

Assume, with the aim of reaching a contradiction, that (d±, . . . , d n ) is not 
a solution to /. Then, there exists a constraint Cj in C not satisfied by 
(g?i, . . . , d n ). Since the constraint relation corresponding to Cj is generalised 
max-closed, there exists a variable Xi in the constraint scope of Cj such that 
Cj has no solution where di is assigned to Xi. Note that it is essential that Cj 
is generalised max-closed to rule out the possibility that there exist two vari- 
ables Xi and Xj in the constraint scope of Cj such that Cj has two solutions 
t,u where t(xi) = di and u(xj) = dj, but Cj has no solution s where s(Xi) = di 
and s(xj) — dj. We know that there exists a constraint in C having Xi in its 
constraint scope and di an allowed value for Xi. This contradicts the fact that 
C is pair-wise consistent. Thus, (di, . . . , d n ) is a solution to I. 

6 Maximal Constraint Languages 

A maximal constraint language T is a constraint language such that (T) C Rd, 
and if R (V), then (ru{i?}} = Rd- That is, the maximal constraint languages 
are the largest constraint languages that are not able to express all finitary re- 
lations over D. This implies, among other things, that there exists an operation 
/ such that (r) = Inv(f) whenever T is a maximal constraint language |45j . 
Relational clones (T) such that T is a maximal constraint language are called 
maximal relational clones. The complexity of the Csp(r) problem for all maxi- 
mal constraint languages on domains \D\ < 3 was determined in |14j . Moreover, 
it was shown in [14] that the only case that remained to be classified in order to 
extend the classification to all maximal constraint languages over a finite domain 
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was the case where (r) = Inv(f) for binary commutative idempotent operations 
/. These constraint languages were finally classified by Bulatov in [8]. 

Theorem 6.1 ([8, 14j) Let T be a maximal constraint language on an arbi- 
trary finite domain D. Then, Csp(T) is in P if (T) = Inv(f) where f is 
a constant operation, a majority operation, a binary commutative idempotent 
operation, or an affine operation. Otherwise, Csp(r) is NT 1 -complete. 

In this section, we classify the approximability of W-Max SOL(r) for all 
maximal constraint languages T over \D\ < 4. Moreover, we prove that the 
only cases that remain to be classified, in order to extend the classification to 
all maximal constraint languages over finite domains, are constraint languages 
r such that (r) is invariant under a binary commutative idempotent operation. 
We also prove that if a certain conjecture regarding minimal clones generated 
by binary operations, due to Szczepara [47], holds, then our classification can 
be extended to capture also these last cases. 

Theorem 6.2 Let T be maximal constraint language on a finite domain D, with 
\D\ < 4, and (T) = Inv(f). 

1. Lf r is generalised max-closed or an injective constraint language, then 
W-Max SOL(r) is in PO; 

2. else if f is an affine operation, a constant operation different from the 
constant operation, or a binary commutative idempotent operation sat- 
isfying f(0, b) > for all b G D \ {0} ( assuming G D); or if ^ D and 
f is a binary commutative idempotent operation or a majority operation, 
then W-Max Sol(T) is APX-complete; 

3. else if f is a binary commutative idempotent operation or a majority op- 
eration, then W-Max SOL(r) is poly-APX-compHe; 

4- else if f is the constant operation, then finding a solution with non-zero 
measure is NP-hard; 

5. otherwise, finding a feasible solution is NP-/iard. 

Moreover, if Conjecture 131 from 0?V holds, then the results above hold for 
arbitrary finite domains D . 

The proof of the preceding theorem consists of a careful analysis of the 
approximability of W-Max Sol(T) for all maximal constraint languages V such 
that (r) = Inv(f), where / is one of the types of operations in Theorem 16.11 
These results are presented below. 

6.1 Constant Operation 

We begin by considering maximal constraint languages that are invariant under 
constant operations. Given an instance / = (V,D,C) of a Csp problem, we 
define the constraint graph of / to be G = (V,E) where {v,v'} G E if there is 
at least one constraint c G C which have both v and v' in its constraint scope. 
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Lemma 6.3 Let d* = max(D) and let Cd be a constraint language such that 
(C d ) = Inv(fd) where fd'.D—^D satisfies f d {x) — d for all Then, W- 

Max SOL(C d .) is in PO, W-Max SOh{C d ) is APX complete if d £ D\{d*,0}, 
and it is NP-hard to find a solution with non-zero measure for W -Max Sol(Co). 

Proof. The tractability of W-Max Soi^Cd*) is trivial, since the optimum so- 
lution is obtained by assigning d* to all variables. 

For the APX-hardness of W-Max SOL(C d ) (d £ D\{d*,0}), it is sufficient 
to note that {(d, d), (d,d*), (d*,d)} is in {Cd), and since < d < d* it follows 
from Lemma fOl that W-Max SOh(C d ) is APX-hard. It is easy to realise that 
W-Max SOL(Cd) is in APX, since we can obtain a ^--approximate solution 
by assigning the value d to all variables. 

The fact that it is NP-hard to find a solution with non-zero measure for 
W-Max Sol(Co) over the Boolean domain {0,1} is proved in [37J Lemma 
6.23]. To prove that it is NP-hard to find a solution with non-zero measure for 
W-Max Sol(Co) over a domain D of size > 3, we give a reduction from the 
well-known NP-complete problem Positive- 1-in-3-Sat [26] . i.e., Csp({i?}) 
with R = {(1,0,0), (0,1,0), (0,0,1)}. It is easy to see that Positive- 1-in- 
3-Sat restricted to instances where the constraint graph is connected is still 
NP-complctc. 

Now, let R' = {(b,a,a),(a,b,a), (a, a, b), (0,0,0)}, where < a < b and 
a, b, G D. For an instance / = (V,D,C) of Csp({i?}) where the constraint 
graph of I is connected, create an instance /' of W-Max SOL({i?'}) by replacing 
all occurrences of R by R' and giving all variables weight 1. Since the constraint 
graph is connected, / has a solution if and only if /' has a solution with non-zero 
measure, and since R' € Co, it follows that it is NP-hard to find a solution with 
non-zero measure for W-Max Sol(Co). 

6.2 Majority Operation 

Maximal constraint languages based on majority operations are fairly easy to 
analyse due to the results in SJU 

Lemma 6.4 Let m be an arbitrary majority operation on D. Then, W-Max 
SOL(Inv(m)) is AP~K-complete if ^ D and poly- APX- complete if £ D. 

Proof. Arbitrarily choose elements a,b £ D such that a < b. Then, it is easy 
to see that {(a, a), (a, b), (b, a)} is in Inv(m). Thus, by Proposition 14.11 and 
Lemmas l4~3l and \4~M it follows that W-Max Soh(Inv(m)) is APX-complete 
or poly-APX-complctc depending on whether is in D or not. 

6.3 Affine Operation 

We split the proof of this result into two parts. The first part, §6.3.11 contains the 
hardness result: for every affine operation a : _D 3 — > D, W-Max SOh(Inv(a)) 
is APX-hard. The proof is based on a reduction from MAX-p-CuT which is 
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a well-known APX-complete problem [2]. Membership in APX is proved in 
£16.3.21 by presenting an approximation algorithm with constant performance 
ratio. 

We will denote the affine operation on the group G by a G , i.e., if G = 
(D, + G , -a) then a G (x, y,z) = x q y + G z. 

6.3.1 APX-hardness 

In this section we will prove Theorem 16. Ill which states that relations invariant 
under an affine operation give rise to APX-hard W-Max SOL-problems. We 
need a number of lemmas before we can prove this result. We begin by giving 
an ^-reduction from MAX-p-CuT to W-Max Sol Eqn(Z p , g) where p is prime. 
MAX-p-CuT and W-Max Sol Eqn are defined as follows: 

Definition 6.5 (|2j) MAX-p-CuT is an optimisation problem with 

Instance: A graph G — (V,E). 

Solution: A partition of V into p disjoint sets Cx, C*2, • ■ • , C p . 
Measure: The number of edges between the disjoint sets, i.e., 



Definition 6.6 ([38j) Let G = (D,+ g ,-q) be a group and g : D — > N a 
function. W-MAX Sol Eqn(G, g) is an optimisation problem with 

Instance: A triple (V,E,w) where, V — {v%, v%, . . . , v n } is a set of variables, 
E is a set of equations of the form U\ +g ■ ■ ■ +g u k = where each Ui 
is either a variable (e.g., "v^"), an inverted variable (e.g., "—gvt") or a 
group constant, and w is a weight function w : V — » N. 

Solution: An assignment f : V — > D to the variables such that all equations 
are satisfied. 

Measure: w { v )9(f( v )) 



We do not require the group G to be Abelian in the definition of W-Max 
Sol Eqn but this will always be the case in this article. Note that the function 
g and the group G are not parts of the input so W-Max Sol Eqn(G, g) is 
a problem parameterised by G and g. We refer the reader to [38) for more 
information on the problem W-Max Sol Eqn(Z p , g), 

The following lemma follows from the proof of Proposition 2.3 in [20] . 

Lemma 6.7 For any instance I = (V, E) of MAX-p-CuT, we have OPt(J) > 




\E\(l-l/p). 



We can now prove the APX-hardness of W-Max Sol Eqn. 
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Lemma 6.8 For every prime p and every non- constant function g :1 V — > N, 
W-Max Sol Eqn(Z p , 5 ) is APX-hard. 

Proof. Given an instance I = (V, E) of MAX-p-CuT, we construct an instance 
F(I) of W-Max Sol EQN(Z p ,g) where, for every vertex Vi G V, we create a 
variable Xi and give it weight 0, and for every edge {vi,Vj} G E, we create p 

(k) 

variables for k = 0, . . . ,p — 1 and give them weight 1. Let g min denote an 
element in Z p that minimises g, i.e., 

min g(x) = g(g min ) 



and let g s denote the sum 



fe=0 



For every edge {uj, Vj} S E, we introduce the equations 

w _ X , _ (fc) 

for k = 0, . .. ,p — 1. If = Xj, then the p equations for the edge 

will contribute Pff((/min) to the measure of the solution. On the other hand, if 

Xi Xj then the p equations will contribute g s to the measure. 

Given a solution s' to F(I), we can construct a solution s to / in the following 
way: let s(uj) = s'(xi), i.e. for every vertex Vi, place this vertex in partition 
s'(xi). The measures of the solutions s and s' are related to each other by the 
equality 

m'(F(I), s') = \E\-p- g(g min ) + (g s - p ■ g(g m in)) ■ m(I, s). (1) 
From |T]), we get 

OPT(F(/)) = \E\-p- g(g min ) + {g s -p- g(g m in)) ■ OPT(J) (2) 

and from Lemma l6.7i we have that OPt(I) > \E\ ■ (1 — l/p) which implies 
OPt(J) > \E\/p. By combining this with ([2]), we can conclude that 

OPT(F(/)) = OPT(J) ( '\ P p / ( ^ min) +9s-P- 5( 5m in) 



< OPT(/)(p 2 -g(g 

min) + gs P ' ^(ffmin) ) ■ 



Hence, (3 = p(p—l)-g(g m in)+gs is an appropriate parameter for the L-reduction. 

We will now deduce an appropriate 7-parameter for the L-reduction: from 
(U) and © we get 

|opt(F(/)) -m'(F(I),s')\ = (g s - P ■ g{g mm )) ■ |opt(7) - m(I, s)\ 

so, 7 = l/(g s — p • g(gmin)) is sufficient (7 is well-defined because a non-constant 
g implies g s > p ■ .g min ). 
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We need two lemmas before we can prove the APX-hardness of affine rela- 
tions. Let vi, V2, ■ ■ ■ ,Vk be a collection of variables, G = (D, +q, —q) an Abelian 
group, and E an equation of the form X\ +a x-2 +g • • • +G x n — c, where each Xi 
is a (possibly inverted) variable and c G D. Note that each variable may occur 
several times in E. The set of all solutions to E may be seen as a fc-ary relation 
Re on D k . The following two lemmas are well-known [3"2"] . 

Lemma 6.9 The relation Re is invariant under aQ. 

Lemma 6.10 If P is a coset of G, then P is invariant under aQ. 

We now have all results needed to prove the main theorem of this section. 

Theorem 6.11 W-Max SOL(Inv(aa)) is APX-Ziard for every affine opera- 
tion aa- 

Proof. We show that there exists a prime p and a non-constant function h : 
Z p — > N such that W-Max Sol Eqn(Z p , h) can be 5-reduced to W-Max 
SOh(Inv(ac))- The result will then follow from Lemma |6~81 

Let p be a prime such that Z p is isomorphic to a subgroup H of G. We 
know that such a p always exists by the fundamental theorem of finitely gener- 
ated Abelian groups. Let a be the isomorphism which maps elements of 7L V to 
elements of H and let h = a. (Note that H C N since the domain is a subset of 
N. Consequently, h may be viewed as a function from Z p to N.) 

Let / = (V, E, w) be an instance of W-Max Sol Eqn(Z p , h) with variables 
V = {v\, . . . , v n } and equations E — {ei, . . . , e m }. We will construct an instance 
I' = (V,D,C,w) of W-Max SoL(Inv(a G )). 

Let U be the unary relation for which x G U x G H ; this relation is in 

Inv{ac) by Lemma 16.101 For every equation Ei G E, there is a corresponding 
pair (sj, R{) where Si is a list of variables and Ri is a relation in Inv(ac) such 
that the set of solutions to Ei are exactly the tuples which satisfies (sj, Ri) by 
Lemma IB~9l We can now construct C: 

C = 17) | 1 < i < n} U {( Si , Ri) 1 < i < to}. 

It is easy to see that J and 7' are essentially the same in the sense that every 
feasible solution to 7 is also a feasible solution to 7', and they have the same 
measure. The converse is also true: every feasible solution to 7' is also a feasible 
solution to 7. Hence, we have given a 5-reduction from W-Max Sol Eqn(Z p , h) 
to W-Max SOL(7?w(aG))- As h is not constant (it is in fact injective), it follows 
from Lemma lBTSl that W-Max Sol Eqn(Z p , h) is APX-hard. This .S-reduction 
implies that W-Max SOh(Inv(aG)) is APX-hard. 

6.3.2 Membership in APX 

We will now prove that relations that are invariant under an affine operation 
give rise to problems which are in APX. It has been proved that a relation 
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which is invariant under an affine operation is a coset of a subgroup of some 
Abelian group [32] • We will give an approximation algorithm for the more 
general problem when the relations are cosets of subgroups of a finite group. 

Our algorithm is based on an algorithm by Bulatov and Dalmau [12] for 
deciding the satisfiability of Mal'tsev constraints. A Mal'tsev operation is a 
ternary operation m such that m(x,y,y) = m(y,y,x) = x for all x,y G D. If 
a constraint language T is invariant under a Mal'tsev operation, then Bulatov 
and Dalmau have proved that Csp(r) is solvable in polynomial time. We note 
that every affine operation is a Mal'tsev operation since x — a y +g V — % and 

V ~G y +G x = x. 

Let G k denote the direct product of k copies of G. We are now ready to 
prove containment in APX. 

Theorem 6.12 Let G = (D; +Gj ~g) be a finite group and let T be a constraint 
language such that for each R G T there is an integer k such that R is a coset 
of some subgroup of G k . Then W-Max SOL(r) is in APX. 

Proof. Let I = (V, D, C, w) be an arbitrary instance of W-Max Sol(T) where 

V = {vi, . . . , v n }. Feasible solutions to our optimisation problem can be viewed 
as certain elements in H = G n . Each constraint Cj 6 C defines a coset a% +g -h 
of H with representative a, G H, for some subgroup Ji of H . The set of solutions 
to the problem is the intersection of all those cosets. Thus, S = C\ i= i a i +G J% 
denotes the set of all solutions. 

Since T is invariant under the affine operation aQ(x,y, z) — x —q y +g z 
and flg is a Mal'tsev operation, we can decide if there are any solutions to / in 
polynomial-time |12j . Clearly, S is empty if and only if there are no solutions. 
It is well-known that an intersection of a set of cosets is either empty or a coset 
so if S 0, then S is a coset. 

We will represent the elements of G n by vectors x = (x±, . . . , x n ) where 
each Xi is an element of G. For any instance /, we define 1Z(I) to be the 
random variable which is uniformly distributed over the set of solutions to /. 
Let Vi denote the random variable which corresponds to the value which will 
be assigned to Vi by TZ{I). We claim that Vi is uniformly distributed over some 
subset of G. As S is a coset there is a subgroup 5" of G n and an element s G S 
such that S = s +g S'. Assume, for the sake of contradiction, that Vi is not 
uniformly distributed. Then, there are group elements a, b G G such that the 
sets 

X a = {x G S' | Xi = a} and X h — {x G 5" | Xi = b} 

have different cardinality. Assume that \X a \ > \Xb\. Arbitrarily pick y G 
X a ,z G Xj, and construct the set Z = {x —q y +g z \ x E X a }. From 
the definition of Z and the fact that S' is invariant under ac, it follows that 
Z C S'. For each x G Z we have X\ = b, hence Z C Xb- However, we also have 
\Z\ = \X a \, which contradicts the assumption that \X a \ > \Xb\- We conclude 
that this cannot hold and Vi is uniformly distributed. Hence, for each 1 < i < n, 
Vi is uniformly distributed. 
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Now, let A denote the set of indices such that for every i £ A, Pr [Vi = cj] = 1 
for some q £ G. That is, A contains the indices of the variables V which are 
constant in every feasible solution. Let B contain the indices for the variables 
which are not constant in every solution, i.e., B — [n] \ A. 

Let S* = J2i£B w ( v i) max(D) + J2ieA w ( v i) c i an d n °te that S* > OPT. 
Furthermore, let 



and note that max(D) > E m \ n > 0. 

The expected value of the measure of TZ(T) can now be estimated as 



Since E m - ln / max(D) > 0, it follows that the measure ofH(I) has, in expectation, 
a constant performance ratio. We will denote ^^jy\ ■ OPT by E. 

To get a deterministic polynomial-time algorithm, note that for any instance 
I we can use the algorithm by Bulatov and Dalmau [12] to compute the two 
sums in ((3]) in polynomial-time. Hence, we can compute the expected measure 
of 7Z(I) in polynomial-time. Our algorithm is presented in Figure Q] 

We claim that the following loop invariant holds in the algorithm: before 
line 4 is executed it is always the case that the expected measure of IZ(Ii) is at 
least E. 

We first prove the correctness of the algorithm assuming that the loop in- 
variant holds. From the loop invariant it follows that the expected measure of 
7tL(/|y| + i) is at least E. In I\v\+i there is, for each variable Vi S V, a constraint 
of the form Vi = Xi, therefore there is only one solution to This solution 

will be returned by the algorithm. 

We now prove that the loop invariant holds. The first time line 4 is reached 
the expected performance ratio of Tt{Ii) is at least E, per the calculations above. 
Now assume that the loop invariant holds in iteration i — k < \ V \ ; we will prove 
that it also holds in iteration i = k + 1. Since the performance ratio of TZ(Ik) 
is at least E, there must be some value x £ D such that when Vi is fixed to x, 
the performance ratio of lZ(Ik+i) is at least E. This element will be found by 
the algorithm as it maximises the expected performance ratio lZ{Ik+i)- Hence, 
the loop invariant holds for i = k + 1. 

6.4 Binary Commutative Idempotent Operation 

We now investigate the complexity of W-Max SOL(r) for maximal constraint 
languages T satisfying (r) = Inv(f) where / is a binary commutative idempo- 
tent operation. 
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Input: An instance I = (V, D, C, to) of W-Max SOL(r) 

Output: A solution with performance ratio at least E m i n / max(D), or "no 
solution" if there are no solutions. 

1. Return "no solution" if there are no solutions (use Bulatov and Dalmau's 
algorithm to check this) 

2. Let Ii = I. 

3. For each i from 1 to |V|: 

4. For each x e D; 

5. Let It = I and add the constraint m = x to 7j 

6. If there is no solution to Jj, then go to 8. 

7. Compute the expected measure of IZ(Ii) 

8. Remove the constraint Mj = x from 7j 

9. Let Xi G D be the value which maximises the expected measure of 
TZ(Ii) in the computations in 4-8. Create a new instance, Ii+i, which 
is identical to h except for the addition of the constraint Vi = x%. 

10. Return the unique solution to 7|y| +1 . 



Figure 1: The algorithm in Theorem 16. 121 
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Let (F; +p, —p, -p, lp) be a finite field of prime order p, where +p, —p, -p, 
and lp denotes addition, subtraction, multiplication and multiplicative identity, 
respectively (we refrain from defining a notation for multiplicative inverses, as 
we do not need it). Furthermore, let zp be the unique element in F such that 
zp + zp = lp. Note that for F = 7L V we get 1^ = 1 and zp — 

Let A denote the set of operations f(x,y) = zp -p (x +p y), where F is a 
finite field of prime order p — \D\ and p > 2. The proof will be partitioned into 
two main cases due to the following result: 

Lemma 6.13 ([14, 49j) If Inv(f) is a maximal relational clone and f is a 
binary idempotent operation, then either 

1. Inv(f) = Inv(g) where g G A; or 

2. B G Inv(f) for some two-element BCD. 

The classification result is given in the next lemma together with a proof 
outline. Full proofs concerning the case when Inv(f) = Inv(g) and g G A 
can be found in H6.4.11 In H6.4.2I we give a complete characterisation of the 
complexity for the second case for domains D such that \D\ < 4. Finally, in 
H6.4.3I we extend the classification to general domains under the assumption of 
a conjecture due to Szczepara ( Conjecture 16. 18[) . 

Lemma 6.14 Let f be a binary commutative idempotent operation on D such 
that Inv(f) is a maximal relational clone, and let T be a constraint language 
such that (r) = Inv(f). 

• If Inv(f) = Inv(g) for some g G A, then W-Max SOL(r) is APX- 
complete; 

• else if \D\ < 4 and there exist a,b G D such that a < b and /(a, b) = a, 
then let a* be the minimal such element (according to <), then 

- W-Max SOL(r) is poly-APX-comp/ete if a* = 0, and 

— APX- complete if a* > 0. 

• Otherwise, if \D\ < A, then W-Max SOL(r) is in PO. 

Proof. If Inv(f ) = Inv(g) and g G A, then the result follows from ij6.4.1l 

If there exist a,b G D such that a < b and /(a, b) = a, then we need to 
consider two cases depending on a*. If a* = 0, then W-Max SOL(r) is poly- 
APX-hard by Lemma 14.41 and a member of poly- APX by Lemma 14.21 since 
Csp is in P [H] . If a* > 0, then W-Max SOL(r) is APX-complete by Lemma 
IQSl in 35X21 

Finally, if there do not exist any a, b G D such that a < b and /(a, b) = a, 
then / acts as the max operation on every two-element BCD such that B G 
Inv(f). Lemma 16.261 shows that / is a generalised max operation in this case, 
and W-Max SOL(r) is in PO by Theorem 03 
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6.4.1 / is contained in A 

We will now prove that W-Max Sol(T) is APX-complete whenever f £ A and 
<r> - Inv(f). 

Lemma 6.15 Let f(x,y) = zp ■ p (x +p y), where F is a finite field of prime 
order p = \D\ > 2 and Inv(f) is a maximal relational clone. Then, W-Max 
SOL(r) is APX-complete if (T) = Inv(f). 

Proof. We will give the proof for F = Z p and after that we will argue that the 
proof can easily be adapted to the general case. 

Let q — and / be the function f(x, y) = q(x + y) (mod p). We will show 
that we can express x — y + z through /. 

Note that 

i=l ^ 

(The second equality follows from Fermat's little theorem: a p_1 = 1 (mod p) 
for any prime p and integer a not divisible by p.) By using ^ and Fermat's 
little theorem again, we get 

p-2 

Xy = -1 (modp). (5) 

i=l 

We can now express x — y + z as follows: 

f(f(f(...f(f(f(x,z),y),y)...),y),y) 

p—1 times 

q(q(q(- ■ ■ q(q(q(x + z) + y) + y) + ...) + v) + y) = 

p-2 

j=i 

x — y + z (mod p) 

where the final equality follows from (01, © and Fermat's little theorem. 

As any finite field F of prime order is isomorphic to Z p , it is not hard to see 
that x —p y +p z can be expressed through / for any such field. Since Inv(f) 
is a maximal relational clone, x —p y +p z can be expressed through /, and 
x ~f y +f z is not a projection, it follows that Inv(f) = Inv(x —p y +p z). 
We now get containment in APX from Theorem l6.12l and APX-hardness from 
Theorem [SHU 

6.4.2 / is not contained in A 

In the first part of this section we classify the complexity of W-Max SOL(r) 
when (r) = Inv(f) for all 2-semilattice operations /. Recall that a 2-semilattice 



P. JONSSON, F. KUIVINEN, AND G. NORDH 



29 



operation / is an operation satisfying the conditions f{x,x) = x, f(x,y) — 
f(y,x), and f(x,f(x,y)) = f(x,y). It is noted in [9] that binary operations 
/ such that Inv(f) is a maximal constraint language on \D\ < 4 are either 2- 
scmilattices or otherwise Csp(r) is NP-complete. Hence, we get a classification 
of the complexity of W-Max SOL(r) when (r) = Inv(f) is a maximal constraint 
language over \D\ < 4 and / is a binary operation. 

The second result in this section is a complete complexity classification of 
W-Max SOL(r) for maximal constraint languages T, such that (r) = Inv(f) 
where / is a binary operation, under the condition that Conjecture 131 from [47] 
holds. 

Lemma 6.16 Let f be a 2-semilattice operation on D and (T) = Inv(f). If 
there exist a,b G D such that a < b, f(a, b) = a, and a* > where a* is the 
minimal element such that there is b* with /(a*, b*) — a* , then W-Max Sol(T) 
is APX- complete. 

Proof. The APX-hardness part is clear. What remains is to show that the 
problem is in APX. We can assume, without loss of generality, that a = a* 
and 6 = 6*. We begin by proving that U = D \ {0} is in Inv(f). Assume 
that f(a, b) = and a, b > 0, then /(a, f(a, 6)) = /(a, 6) = and consequently 
/(a, 0) = contradicting the assumption that a > was the minimal such 
element. Hence, f(a, 6) = if and only if a = b = 0. In particular U is in 
Inv(f). 

We continue with the actual proof of the lemma. Let / = (V, D, C, w) be an 
arbitrary instance of W-Max SOL(r). Define V' C V such that 

V = {v G V S(v) = for every solution S of I}. 

We see that V can be computed in polynomial time: a variable v is in V 1 if 
and only if the Csp instance (V, D, C U {((v), U)}) is not satisfiable. 

Given two assignments A, B : V — > D, we define the assignment f(A, B) 
such that f(A, B)(v) = f(A(v), B(v)). We note that if A and B are solutions of 
/, then f(A, B) is a solution to /, too: indeed, arbitrarily choose one constraint 
((x u ...,x k ),r) £ C. Then, (A( Xl ), . . . , A(x k )) e r and (B(xi), . . . , B(x k )) G r 
which implies that {f{A{x\),B{x{)) 1 . . . , f(A(xk), B(xk) j) G r, too. 

Let Si, ... , S m be an enumeration of all solutions of I and define 

S + - /(Si, f(S 2 J(S 3 . . . f(S m - l} S m ) . . .))). 

By the choice of V and the fact that f(c, d) = if and only if c = d = 0, 
we see that the solution S + has the following property: S + (v) — if and 
only if v G V . Let p denote the second least element in D, and note that 
OPT(J) > Y^veVYV' w ( v )p — c - Thus, by finding a solution with measure > c, 
we have approximated / within (m&xD)/p and W-Max SOL(r) is in APX. 
To find such a solution, we consider the instance /' = (V, D, C, w), where 
C = C U {((v), u) | v G V \ V'}. This instance has feasible solutions (since S + 
is a solution) and every solution has measure > c. Finally, a concrete solution 
can be found in polynomial time by the result in [19] . 
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Lemma 6.17 If f is a 2-semilattice operation such that f $ A, T is a maximal 
constraint language satisfying (T) = Inv(f), and for all two-element B 6 Inv(f) 
the operation f acts as the max operation on B, then W-Max Sol(T) is in PO. 

Proof. What we will prove is that if / acts as max on all two-element B E 
Inv(f), then / is a generalised max operation and consequently W-Max Sol(T) 
is in PO. 

First note that if a ^ b and /(a, b) = a, then by assumption a > b and 
/(a, b) > min{a, b}. Now, if f(a,b) ^ a, then /(a, /(a, b)) — f(a,b) and by 
assumption / is max on {a, /(a, b)}. As a consequence of this we get /(a, b) > 
min{a, b}. Now, /(a, b) > min{a, b} for all a ^ b. Moreover, / is idempotent, so 
/ is a generalised max operation and tractability follows from Theorem 15. 101 

We have now completely classified the complexity of W-Max Sol(T) for all 
constraint languages T such that (r) is maximal and \D\ < 4. 

6.4.3 Complete Classification under a Conjecture 

In this section we will prove that the validity of Conjecture 131 from [47| im- 
plies a complete complexity classification of W-Max Sol(T) for all constraint 
languages T such that (r) is maximal. Given a binary operation / on D, the 
fixity of / is denoted J-(f) and is defined by 

T{f) = {{x,y)ED 2 \f(x,y) e {x, y}}. 

The fixity-count of / is defined to be the cardinality of !F(f) and is denoted 

\Hf)\- 

Conjecture 6.18 (|47J, Conjecture 131) If Inv(f) is a maximal relational 
clone and Inv(f') = Inv(f), then \T{f)\ — \T(f')\. 

Although Conjecture 16.181 is not known to hold in the general case, it has 
been verified for small domains. In particular, it was shown in [47] that for 
domains D such that \D\ < 4 the conjecture holds. Our proof builds on a 
construction that facilitates the study of operation / — the details are collected 
in Lemma 16.191 The underlying idea and the proof of Lemma 16.191 are inspired 
by Lemma 3 in [14] . 

Let / be a binary operation on D and define operations fi, f%, ■ . . '■ D 2 — > D 
inductively: 

fi(x,y) = f(x,y) 
f n+ x(x,y) = f(x,f n (x,y)). 

Lemma 6.19 Assume f to be a binary commutative idempotent operation on 
D such that Inv(f) is a maximal relational clone and Inv(f) ^ Inv(g) for every 
g G A. The following holds: 

1- /|b = fn\B for every n > 1 and every two-element B C D in Inv(f); and 
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2. Inv(f)=Inv{f n ), n>l. 

Proof. 1. Arbitrarily choose a two-element {a, b} = B C D in Inv(f). There 
are two possible binary commutative idcmpotent operations on B, namely max 
and min. We assume without loss of generality that /|s = max and prove the 
result by induction over n. Since f\ — /, the claim holds for n = 1. Assume 
it holds for n = k and consider fk+i- We see that fk+i{a,b) = f(a,fk(a,b)) 
and, by the induction hypothesis, fk(a,b) = max(a, b). Hence, fk+i{a,b) = 
max(a, max(a, b)) = max(a, b). 

2. Obviously, /„ G Pol(Inv(f)) and, thus, Inv(f) C Inv(f n ) C R D . Since 
Inv(f) ^ Inv(g) for every g G A, we know from Lemma 16. 131 that there is some 
two-element B G Inv(f). By the proof above, we also know that f\s = fn\B 
so fn\B (and consequently /„) is not a projection. Thus, Inv(f n ) ^ Rd, since 
Inv(f') = Rd if and only if /' is a projection. By the assumption that Inv(f) 
is a maximal relational clone and the fact that Inv(f) C Inv{f n ) C R Dl we can 
draw the conclusion that Inv(f) = Inv(f n )- 

We will now present some technical machinery that is needed for proving 
Lemmas 16.251 and 16.261 

Lemma 6.20 (|47J, Lemma 28) Let f be an idempotent binary operation and 
neN. Then, T(f)QT(f n ). 

Proof. Let (x,y) G F{f)- Then, either f(x,y) = x or f(x,y) = y. Now 
f(x, y) = x=> f n {x, y) = f(x, f(x, . . . , f(x, ?/)...)) = 

V v ' 

n times 

f(x, f(x, f(x, x)...))=x=> f n (x, y) = x. 

Ti—1 times 

While 

f(x, y)=y=> f n (x, y) = f(x, f(x, . . . , f(x, y)...)) = 

" v ' 

n times 

f(x, f(x, f(x, y) . . . )) => f n (x, y) = y. 
.. ' 



Assuming that Conjecture 16.181 holds, we get the following corollary as a 
consequence of Lemma 16.201 

Corollary 6.21 // Inv(f) is maximal relational clone such that f is commu- 
tative, idempotent, and (x,y) G J-{fk), (i-e. fk{x,y) G {x,y}), then {x,y} G 
Inv(f). 

Proof. By Lemma [6.201 we have J-(f) C T(fk), and if Conjecture 16.181 holds, 
then \T{f)\ = \T{f k )\ which implies that T{f) - T{f k ). Now, if f k {x,y) G 
{x, y}, then f(x,y) G {x,y} and by the commutativity of / we have f{y,x) G 
{x,y}. Since / is idempotent, it is clear that {x,y} G Inv(f). 
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We continue by introducing a digraph associated with the binary operation 
/. This digraph enables us to make efficient use of Lcmma l6.19l Given a binary 
operation / : D 2 — » D, we define Gf = (V,E) such that V — D x D and 
E = {((a, b), (a, /(a, &))) | a, b G D}. We make the following observations about 
G f : 

(1) an edge ((a, b), (a, c)) implies that f(a, b) = c; 

(2) every vertex has out-degree 1; and 

(3) there is no edge ((a, b), (c, d)) with a ^ c. 

We extract some more information about Gf in the next three lemmas. 
Lemma 6.22 The digraph Gf contains no directed cycle. 

Proof. Assume Gf contains a directed cycle. Fact (3) allows us to assume 
(without loss of generality) that the cycle is (0, 1), (0, 2), . . . , (0, k), (0, 1) for 
some k > 2. Fact (1) tells us that /(0, 1) = 2, /(0, 2) = 3, . . ., /(0, k - 1) = k 
and f(0,k) = 1. Furthermore, one can see that /2(C), 1) = 3, /2(C), 2) = 4, 
. . ., and inductively f p (0,i) = i + p (mod fc). This implies that /fe(0, 1) = 
1 + k (mod k) — 1. By Corollary 16.211 {0, 1} is a subalgebra of Inv(f) which 
contradicts the fact that /(0, 1) = 2. 

Lemma 6.23 Every path in Gf of length n > \D\ ends in a reflexive vertex, 
i.e., f n (a,b) = c implies that (a,c) is a reflexive vertex. 

Proof. Assume that Gf contains a path P of length n > \D\. This path can 
contain at most \D\ distinct vertices by fact (3). Fact (2) together with the 
acyclicity of Gf implies that at least one vertex v on P is reflexive; by using 
fact (2) once again, we see that there exists exactly one reflexive vertex on P 
and it must be the last vertex. 

Lemma 6.24 If f n (a,b) — c, then (a, c) is a reflexive vertex in Gf. 

Proof. By Lemma 16.231 every path in Gf of length n > |D| ends in a reflexive 
vertex. Hence, (a, / n (a, b)) = (a, c) is a reflexive vertex. 

Lemma 6.25 Let f be a binary commutative idempotent operation on D such 
that r is a maximal constraint language satisfying (T) = Inv(f). If there exist 
a,b G D such that a < b, f(a, b) = a, and a* > where a* is the minimal ele- 
ment such that there is b* with f(a*,b*) — a*, then (assuming Conjecture 1 6. 18}) 
W-Max SOL(r) is APX-complete. 

Proof. We can assume, without loss of generality, that a = a* and b = b*. The 
APX-hardness part follows from Lemma 14.31 What remains is to show that 
the problem is in APX. We begin the proof by proving that the unary relation 



P. JONSSON, F. KUIVINEN, AND G. NORDH 



33 



U = D \ {0} is a member of Inv(f). Consider the digraph Gf. As we have 
already observed in Lemma [67221 there are no cycles (a, b\), . . . , (a, (a, &i), 
fc > 2, in Gf and every path of length n > \D\ ends in a reflexive vertex (by 
Lemma I6.23|) . Obviously, no vertex (a, 0) (a > 0) in Gf is reflexive since this 
implies that /(a,0) = which is a contradiction. In particular, there exists no 
path in Gf of length n > \D\ starting in a vertex (a, 6) (a > 0) and ending in a 
vertex (a,0), since this implies that (a, 0) is reflexive by Lemma T6.23I 

We can now conclude that f n (a,b) > when a > 0: if f n (a,b) = 0, 
then (a, 0) is reflexive by Lemma 16.241 which would lead to a contradiction. 
Hence, f n (a,b) > whenever a,b E D\ {0} = U so U is in Inv(f n ), and by 
Lemma 16.19( 2). U is in Inv(f), too. We also note that U £ Inv(f) together 
with the assumption that /(0, b) > for all 6 > implies that /(c, d) = if and 
only if c = d = 0. The rest of the proof is identical to the second part of the 
proof of Lemma 16.161 

Lemma 6.26 If f is a binary commutative idempotent operation such that f SjL 
A, r is a maximal constraint language satisfying (T) = Inv(f), and for all 
two-element B € Inv(f) the operation f acts as the max operation on B, then 
(assuming Coniecture \6.18\) W-Max Sol(T) is in PO. 

Proof. What we will prove is that if / $ A and / acts as max on all two- 
element B € Inv(f), then there exists a generalised max function /' such that 
Inv(f') = Inv(f) and, hence, W-Max SOL(r) is in PO. 

Recall that there are no cycles in Gf and every path of length n = \D\ must 
end in a reflexive vertex by Lemmas 16.221 and 16.231 We also note that if Gf 
contains a reflexive vertex (a, c) with a =/= c, then /(a, c) = c and c > a since / 
is assumed to act as the max operation on all two-element B € Inv(f). 

We now claim that /„ is a generalised max operation. Arbitrarily choose 
a,b G D. If f n (a,b) = c (a ^= c), then there is a path in Gf from (a. b) to 
a reflexive vertex (a, c), and c > a as explained above. If f n (a,b) = a, then 
{a, b} S Inv(f) by Corollary 16.211 Since f(a,b) = max(a, b), Lemma 16.19( 1) 
implies that f n (a,b) — max(a,6). Thus, /„ is a generalised max-operation. 

7 Homogeneous Constraint Languages 

In this section, we will classify the complexity of Max Sol when the constraint 
language is homogeneous. A constraint language is called homogeneous if every 
permutation relation is contained in the language. 

Definition 7.1 A relation R is a permutation relation if there is a permutation 
7r : D — > D such that 

R = {(a;,7r(:c)) | x 6 D}. 

Let Q denote the set of all permutation relations on D. The main result of this 
section is Theorem 17.161 which gives a complete classification of the complexity 
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of W-Max SOL(r) when Q C T. The theorem provide the exact borderlines 
between tractability, APX-completeness, poly-APX-completeness, and NP- 
hardness of finding a feasible solution. 

As a direct consequence of Theorem 17.161 we get that the class of injective 
relations is a maximal tractable class for W-Max SOL(r). That is, if we add 
a single relation which is not an injective relation to the class of all injective 
relations, then the problem is no longer in PO (unless P = NP). 

Dalmau has completely classified the complexity of Csp(T) when T is a 
homogeneous constraint language [23], and this classification relies heavily on 
the structure of homogeneous algebras. An algebra is called homogeneous if and 
only if every permutation on its universe is an automorphism of the algebra. We 
will not need a formal definition of homogeneous algebras and refer the reader 
to [39] [40l [48] for further information on their properties. All homogeneous al- 
gebras have been completely classified by Marczewski [40] and Marchenkov [39] . 

Our classification for the approximability of W-Max SOL(r) when T is a 
homogeneous constraint language uses the same approach as in |23j , namely, we 
exploit the inclusion structure of homogeneous algebras (as proved in [3"9l l4"0] ). 
By Theorem 13.31 it is sufficient to consider constraint languages T that are 
relational clones. This is where the homogeneous algebras comes in: the clas- 
sification of homogeneous algebras gives us a classification of all homogeneous 
relational clones, and in particular their inclusion structure (lattice) under set 
inclusion. We refer the reader to [IS] for a deeper treatment of homogeneous 
algebras and their inclusion structure. 

The lattice of all homogeneous relational clones on a domain D having n 
(> 5) elements is given in Figure [2] The lattices for the corresponding rela- 
tional clones over smaller domains (i.e., 2 < \D\ < 4) contains some exceptional 
relational clones and are presented separately in Figures 0431 Note that the 
corresponding lattices presented in [23] and |48j are the dual of ours, since they 
instead consider the inclusion structure among the corresponding clones of op- 
erations (but the two approaches are in fact equivalent as shown in [43], Satz 
3.1.2]). To understand the lattices we first need some definitions. 

Throughout this section n denotes the size of the domain D, i.e., n = \D\. 

Definition 7.2 

• The switching operation s is defined by 




ifa = b, 
ifa = c, 
otherwise. 



• The discriminator operation t is defined by 




ifa = b, 
otherwise. 




Figure 2: Lattice of all 



homogeneous 



relational clones 



over domain size n > 5. 
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Figure 4: Lattice of all homogeneous relational clones over domain size n 
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• The dual discriminator operation d is defined by 

. (a if a = b, 
d{a, b, c) = \ J ,, 

c otherwise. 



• The k-ary near projection operation Ik (3 < k < n) defined by 

, . _ J ax if\{ax,...,a k }\ < k, 

' fc(fll '- ,at) - \ a fc ofter«e. 

• T7ie (n — l)-ary operation r n defined by 

r„(ai, . . . , a n _i) = 



ai i/ |{ai, . . . ,a„-i}| < n - 1, 
a n otherwise. 



In the second case we have {a n } = D \ {a l7 . . . , a n _i}. 
• The (n — \)-ary operation d n (where n > A) defined by 



d n (ai, . . . , a n -i) 



d(ai,a 2 ,a 3 ) if |{ai, . . . , a n _i}| < n - 1, 
a„ otherwise. 



In the second case we have {a n } = D \ {ai, . . . ,a„_i}. 

• i/ie operation x + y + z where (D, +, — ) is a A-element group of exponent 
2. 

The notation in the lattices in Figures [2Hil is explained below. 

• D\ = Inv(t): 

• D9 = Inv({d, for 2 < i < n - 1; 
. D° = Jnv(d); 
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• 


n 1 


— Inv({t, r n }): 


• 


n 1 


Tin ft i fS A 1 v \ \ -p/-»v <^ ri <^ m 9 • 

— 1 TiV \\CL, H+l : ' n J ) ^Ox Z \ 2 \ 71 — Z, 


• 


D l n 


= Inv(d n ); 


• 


El 


= Inv(s); 


• 


E9 


— Inv(li+i) for 2 < i < n — 1; 


• 


E° n 


= i-e., all finitary relations over _D 


• 


El 


= Inz;({s,r n }) for n ^ 3; 


• 


El 


= te'({i, + i,r„}) for 2 < i < n — 3; 


• 


El 


_ 2 = Inv(r n ) for n > 4. 



Note that the relational clones described above depend on the size of the domain 
\D\ = n. Hence, in Figure |4] = 3) is not the same relational clone as 
E® (\D\ = 4) in Figure [3] Also note that when we state our (in)approximability 
results by saying, for example that, W-Max Sol(EI) is APX-complete, we 
mean that W-Max Sol(£' 1 1 ) is APX-complete for all sizes of the domain where 
El is defined (e.g., El is not defined for n = 3). We always assume that 
n = \D\ > 2. 

We now state Dalmau's classification for the complexity of Csp(r) for ho- 
mogeneous constraint languages T. 

Theorem 7.3 ( [23j ) Let T be a homogeneous constraint language. Then, Csp(r) 
is in P if Pol (T) contains the dual discriminator operation d, the switching op- 
eration s, or an affine operation. Otherwise, Csp(r) is NP -complete. 

We have the following corollary of Dalmau's classification. 

Corollary 7.4 Let T be a homogeneous constraint language. Then, W-Max 
SOL(r) is in poly-APX if Pol (T) contains the dual discriminator operation d, 
the switching operation s, or an affine operation. Otherwise, it is NP-hard to 
find a feasible solution to W-Max SOL(r). 

Proof. All dual discriminator operations, switching operations, and affine oper- 
ations are idempotent (i.e., f(x,x,x) = x for all x G D). Hence, T is invariant 
under a dual discriminator operation, switching operation, or an affine operation 
if and only if T c = {ru{{(di)}, . . . , {{d n )}} is invariant under the corresponding 
operation. Thus, it follows from Theorem [731 that Csp(r c ) is in P if Pol(T) con- 
tains the dual discriminator operation d, the switching operation s, or an affine 
operation. This together with Lemma [4.21 gives us that W-Max SOL(r) is in 
poly-APX if Pol(T) contains the dual discriminator operation d, the switching 
operation s, or an affine operation. 

The NP-hardness part follows immediately from Theorem 17.31 

We begin by investigating the approximability of W-Max SOL(r) for some 
particular homogeneous constraint languages T. 
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Lemma 7.5 W-Max Sol(D°) is in APX if D and in poly-APX oth- 
erwise. 

Proof. Remember that = Inv(d). Hence, membership in poly-APX fol- 
lows directly from Corollary 17.41 It is known from Dalmau's classification that 
Csp(D°) is in P. Thus, by Proposition |4~U it follows that W-Max Sol(D°) is 
in APX when 0<£D. 

Lemma 7.6 W-Max Sol(D^) is APX- complete if £ D and poly-APX- 

complete j/0 £ D. 

Proof. Choose any a,b 6 D such that a < b. The relation r = {(a, a), (a, b), (b, a)} 
is in D\ = Inv({d, k+i, r n }) for 2 < i < n — 2. Hence, by Lemmas 14.31 and 14.41 
it follows that W-Max Sol(D^) is APX-hard if ^ D and poly-APX-hard if 
G D. This together with Lemma [731 and fact that Dj C give us that W- 
Max Sol(D\) is APX-complete if ^ D and poly-APX-complete if £ D. 



Lemma 7.7 Finding a feasible solution to W-Max Soi^E^) is NP-hard. 

Proof. Remember that E\ — /nw({Z 3 , r„}) when n > 4 and E\ = Inv(r n ) when 
n = 4, so it follows from Dalmau's classification that Csp(£'|) is NP-complete. 



Lemma 7.8 W-Max Sol(D?) is in PO. 

Proof. It is well-known that = Inv(t) = (I D ); for instance, it is a direct 
consequence of Theorem 4.2 in [48]. Hence, W-Max Sol(DJ) is in PO by the 
results in i i5.ll 

Lemma 7.9 W-Max Sol(^) is in APX. 

Proof. Remember that = Inv(s). Dalmau gives a polynomial-time algorithm 
for Csp(7m;(s)) in [23] (he actually gives a polynomial-time algorithm for the 
more general class of para-primal problems). Dalmau's algorithm exploits in 
a clever way the internal structure of para-primal algebras to show that any 
instance / of Csp(Inv(s)) can be split into independent subproblems I\, . . . , Ij, 
such that 

• the set of solutions is preserved (i.e., any solution to / is also a solution 
to each of the independent subproblems, and any solution to all of the 
independent subproblems is also a solution to 7); and 

• each Ij (1 < i < j) is either an instance of Csp(Inv(t)) or an instance 
of Csp(Inv(a)), where t is the discriminator operation and a is an affine 
operation. 
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Hence, to show that W-Max Sol(E°) is in APX, we first use Dalmau's al- 
gorithm to reduce the problem (in a solution preserving manner) to a set of 
independent W-Max Sol(T) problems where T is either invariant under an 
affinc operation or the discriminator operation. We know from Lemma 17.81 that 
W-Max SOL(r) is in PO when T is invariant under the discriminator operation, 
and from Theorem 16.121 we know that W-Max Sol(T) is in APX when T is 
invariant under an affine operation. Since all the independent subproblems are 
in APX, we get that the original W-Max Sol(E^) problem is also in APX. 

Lemma 7.10 W-Max Sol(EI) is APX-complete. 

Proof. Remember that E\ = Inv({s,r n }). Note that E\ C E\ so membership 
in APX follows from Lemma [731 

For the hardness part, we begin by considering the general case when n = 
\D\ > 4. Choose an arbitrary two-element subset {a, b} of D (without loss of 
generality assume that a < b) and let (G, +, — ) be the two element group on 
G = {a, b} defined by a + a = a, a + b = b + a = 6, and b + b = a. Let T 
be the set of all relations expressible as the set of solutions to equations over 
(G, +, — ). It is easy to realise that T is invariant under r„ (since r n (n > 4) acts 
as a projection on {a, b}). Furthermore T is invariant under s since s(x 7 y,z) 
acts as the affine operation x + y + z on {a, 6}. It is proved in Lemma 16.81 that 
W-Max Sol EQN(Z 2 ,g) is APX-hard so W-Max SOL(r) is APX-complete. 
For n = \D\ = 3 there is no relational clone of the type El = Inv({s,r n }) so 
the only case that remains to be dealt with is the case where n = \D\ = 2. 

Without loss of generality assume that D = {a,b} where a < b. Again 
consider the group (G, +, — ) on {a, b}. Let T = {i?i, i? 2 } where i?i is the (4-ary) 
relation on D which is the set of solutions to the equation x\ + X2 + X3 + £4 = a 
and i? 2 is the (binary) relation representing the set of solutions to the equation 
Vi + V2 = b. Furthermore, let T ^ = {i?i,i? 2 } denote the special case where 
a = 0, b = 1 (i.e., D = {0, 1}). It has been proved in [37j Lemma 6.9] that Max 
Sol(Fo ! i) is APX-complete. Let I be an instance of Max Sol(Fo i i) containing 
k variables. It is easy to realise that if / has a solution, then OPt(I) > k/2 (just 
note that the complement of any solution to / is also a solution to /). We 
give an L-reduction from Max SOL(r ,i) to Max SOL(r aj& ). Let F(I) be the 
instance of Max SOL(r ai f,) where all occurrences of has been replaced by a 
and all occurrences of 1 has been replaced by b. Since OPt(I) > k/2, we get 
that OPt(F(/)) < bk < 2b ■ OPt(J) and — 2b is a valid parameter in the 
L-reduction. Let s be an arbitrary solution to F(I) and define G(F(I), s) to be 
the corresponding solution to / where a is replaced by and b is replaced by 1. 
Then, 

\m(I, G(F(I), s)) - opt(7)| < ^L-\ m (F(T), 8 ) - opt(F(I))\ 

and 7 = t^— is a valid parameter in the L-reduction. This completes the APX- 
hardness proof for Max SOL(r a ;,). Now, the unary operation r 2 acts as the 
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non-identity permutation on {a, b} (i.e., r 2 (a) — b, and r 2 (b) = a) so both i?i 
and R 2 are invariant under r 2 . As we have already observed, s acts as the 
affine operation on {a, b} and R\ and R 2 are invariant under s, too. Hence, 
r<i,& C Inv({s,r 2 }) which concludes the proof. 

We have now proved all the results needed to give a complete classification for 
the approximability of W-Max Sol(T) for all homogeneous relational clones T 
over domains D of size at least 5. In order to complete the classification also for 
domains of size 2, 3 and 4, we need to consider some exceptional homogeneous 
relational clones. For domains of size 4, we need to consider the homogeneous 
relational clone Inv(x + y + z) where + is the operation of a 4-element group 
(D, +, — ) of exponent 2 (i.e., a 4-element group such that for all a 6 D, a+a = e 
where e is the identity element in (£),+,—)). 

Lemma 7.11 Let f(x, y, z) = x + y + z where (D, +, — ) is a group of exponent 
2. Then, W-Max SOh(Inv(f)) is APX- complete. 

Proof. The operation x + y + x is the affine operation on (_D, +, — ) (since — y = y 
in (D, +, — )) and it follows directly from Theorem 16.111 and Theorem 16 . 1 21 that 
W-Max SoL(Inv(x + y + z)) is APX-complete. 

For 3-element domains, it remains to classify the approximability of W-Max 
Soh(Inv(r3)) where r^ is the binary operation defined as follows: 

r(a a ) — { 01 ^ Gl = ° 2 ' 

1 a3 where {a 3 } = D \ {a%, a 2 } otherwise. 



Lemma 7.12 W-Max SOh(Inv(r 3 )) is APX-complete. 

Proof. The operation r^(x, y) is actually an example of an operation of the type 
^ip- (x + y) (where + is the operation of an Abelian group of order \D\ = p) 
from Lemma 16.151 In our case p = 3 and r 3 (x,y) = 2x + 2y where + is the 
operation of the Abelian group (£>,+,—) isomorphic to Z3. Hence, it follows 
from Lemma l6~T5l that W-Max SOh(Inv(r 3 )) is APX-complete. 

For 3-element domains we also need to classify the approximability of W- 
Max SOL(i?2) since hardness no longer follows from the hardness of W-Max 
SOL(i?2) (there is no relational clone E\ over 3-element domains). 

Lemma 7.13 It is NP-hard to find a feasible solution to W-Max Sol(E^). 

Proof. Immediate consequence of Theorem 17.31 

Similarly, we also need to classify the approximability of W-Max Sol(Z?2) 
since hardness no longer follows from the hardness of W-Max Sol(D 2 ) (there 
is no relational clone D\ over 3-element domains). 

Lemma 7.14 W-Max Sol(D§) is APX-complete if '0 £ D and poly-APX- 

complete ifOGD. 
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Proof. Remember that D® = Inv({d, h}). It follows from the proof of Lemma 
ESJthat W-Max Sol(D^) is APX-complete if £ D and poly-APX-complete 
if 6 D. 

For two-element domains {a, b}, we need to classify the unary operation ri 
which acts as the non-identity permutation (i.e., ri{a) = b and ^2(6) = a). 

Lemma 7.15 Finding a feasible solution to W-Max SOh(Inv(r2)) is NP- 
hard. 

Proof. Follows from Dalmau's classification. 

Finally, we are in the position to present the complete classification for the 
approximability of all homogeneous constraint languages. 

Theorem 7.16 Let T be a homogeneous constraint language. 

1. If (r) e {E) J i e {0, 1}, j > 2} or (r) = Inv(r 2 ), then it is NP-hard to 
find a feasible solution to W-Max SOL(r); 

2. else if,0<ED and (T) G {D) \ i e {0, > 2}, then W-Max SOL(r) is 
poly-APX-comp/ete; 

3. else if, 

(r) £ {El,E°,Inv{x + y + z),Inv(r 3 )} or 
(r) e {D) | i e {0,1}, j > 2} andO i D, 

then W-Max SOL(r) is APX-complete; 

4. otherwise, (T) E {D\,D\} and W-Max SOL(r) is in PO. 

Proof. We know from Theorem 13.31 that it is sufficient to consider constraint 
languages that are relational clones. 

1. It is proved in Lemmas 17.71 and 17.131 that it is NP-hard to find a feasi- 
ble solution to W-Max Sol(^) and W-Max Sol^). NP-hardness 
of finding a feasible solution to W-Max SOh(Inv(r2)) was proved in 
Lemma OS] The result follows from the fact that E\ C E) and E° C E° 
(2<j<n). 

2. Membership in poly-APX is proved in Lemma 17.51 and poly-APX- 

hardness of W-Max Sol(DI) and W-Max Sol(D%) when € D is 
proved in Lemmas 17.61 and 17.141 The result follows from the fact that 
D\ C D) C Dl and D° 2 C D° C D° n (2 < j < n). 

3. It is proved in Lemmas I7TTT1 and I7T21 that W-Max SOh(Inv(x + y + z)) 
and W-Max SOL(/nu(r3)) are APX-complete. It is proved in Lemma 17791 
that W-Max Sol(£0) [ s i n APX. APX-hardness for W-Max Sol(^ 1 1 ) 
is proved in Lemma 17.101 For n > 4 or n = 2 we have that El C E® 
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and it follows that W-Max Sol(E^) and W-Max Sol(^ 1 1 ) are APX 
complete. For n — 3, there exists no El so APX-hardness for W-Max 
Sol(£'j ) ) must be proved separately. Since E® = Inv(s) it is easy to see 
that the proof of Lemma iTTTul gives APX-hardness for W-Max Sol(E^). 

Membership in APX for W-Max Sol(L>°) when D is the first 
part of Lemma [731 APX-hardness of W-Max Sol(£>^) and W-Max 
Sol(Z?2) are proved in Lemmas 17.61 and IT. 141 respectively. Hence, APX- 
completeness of W-Max Sol(L>°) and W-Max Sol(D)) (2 < j < n) 
when £ D follows from the fact that D\ C D) C D\ C B\ C D° 
(2<J<n). 

4. It is proved in Lemma FT8l that W-Max Soi^D?) is in PO and the result 
follows from the fact that D\ C D°. 

As a direct consequence of the preceding theorem, we get that the class of 
injective relations is a maximal tractable class for W-Max Sol(T). That is, 
if we add a single relation which is not an injective relation to the class of all 
injective relations, then the problem is no longer in PO (unless P = NP). 

Corollary 7.17 Let be the class of injective relations and R an arbitrary 
relation which is not in Tf . Then, W-Max SOLfTf 5 U {R}) is not in PO 
(unless P = NP). 

Proof. We know from the proof of Lemma FT8l that L»J = Inv(t) = T? = {I D ). 
It follows from the lattices of homogeneous relational clones that either E° C 
(D? U {R}) or Dl C (£>§> U {R}). We know from Lemma [TM and Lemma EU 
that both W-Max Sol(£^) and W-Max Sol(D^) are APX-hard. Thus, W- 
Max Sol{D1 U {R}) is APX-hard and it follows that W-Max SOL(rf U {R}) 
is not in PO (unless P = NP). 

8 Conclusions 

We view this article as a first step towards a better understanding of the ap- 
proximability of non-Boolean W-Max Sol. The ultimate long-term goal for 
this research is, of course, to completely classify the approximability for all fi- 
nite constraint languages. However, we expect this to be a hard problem since 
not even a complete classification for the corresponding decision problem Csp 
is known. A more manageable task would be to completely classify W-Max 
Sol for constraint languages over small domains (say, of size 3 or 4). For size 
3, this has already been accomplished for Csp JTD] and Max Csp [31]. Another 
obvious way to extend the results of this paper would be to complete the classi- 
fication of maximal constraint languages over arbitrary finite domains, perhaps 
by proving Conjecture 131 from [4"T| . 

Our results combined with Khanna et al. 's [37] results for Boolean domains 
suggest the following conjecture: 

Conjecture. For every constraint language T, one of the following holds: 
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1. W-Max SOL(r) is in PO; 

2. W-Max SOL(r) is APX-complete; 

3. W-Max SOL(r) poly-APX-complete; 

4. it is NP-hard to find a non-zero solution to W-Max SOL(r); or 

5. it is NP-hard to find any solution to W-Max Sol(T). 

If this conjecture is true, then there does not exist any constraint language 
Ti such that W-Max Sol(Ti) has a polynomial-time approximation scheme 
(Ptas) but W-Max Sol(Ti) is not in PO. Natural such classes exist, how- 
ever, if one restricts the way constraints are applied to variables (instead of 
restricting the allowed constraint types). Maximum Independent Set (and, 
equivalently, Max Ones({(0, 0), (1, 0), (0, 1)})) is one example: the unrestricted 
problem is poly-APX-complete and not approximable within 0{n l ~ e ), e > 
(unless P=NP) [52], but the problem restricted to planar instances admits 
a Ptas [1]. One may ask several questions in connection with this: is there 
a constraint language with the properties of Ti above? For which constraint 
languages does W-Max Sol admit a Ptas on planar instances? Or more gen- 
erally: under which restrictions on variable scopes does W-Max SOL(r) admit 
a Ptas? 

It is interesting to note that the applicability of the algebraic approach to 
W-Max Sol demonstrated in this article also holds for the corresponding min- 
imisation problem W-Min Sol, that is, Theorem 13.31 still holds. The ques- 
tion whether the algebraic approach can shed some new light on the intriguing 
approximability of minimisation problems (as manifested, e.g., in [37]) is an 
interesting open question. 

As mentioned in the introduction, it is known from [37) that the approx- 
imability of the weighted and unweighted versions of (W)-MAX Sol coincide 
for all Boolean constraint languages. We remark that the same result holds 
for all constraint languages considered in this article. This can be readily veri- 
fied by observing that the AP-reduction from W-Max Ones to Max Ones in 
the proof of Lemma 3.11 in |37j easily generalises to arbitrary finite domains. 
Hence, we get an AP-reduction from W-Max Sol to Max Sol. Furthermore, 
our tractability proofs are given for the weighted version of the problem. In gen- 
eral, it is still an open problem if tractability (i.e., membership in PO) of Max 
SOL(r) implies tractability of W-Max SOL(r) for every constraint language T 
(the j4P-reduction used above do not give us this result as AP-reductions do 
not, in general, preserve membership in PO). 
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